[/home/ycchen/BTEC/lm/dev3.lm.detoken, /home/ycchen/BTEC/E_output/dev3.same, /home/ycchen/BTEC/E_output/IWSLT07_CE_devset3_IWSLT05_E.output.google2, /home/ycchen/BTEC/E_output/IWSLT07_CE_devset3_IWSLT05_E.output.otek, /home/ycchen/BTEC/E_output/IWSLT07_CE_devset3_IWSLT05_E.output.yahoo] vs. [/s0/ycchen/IWSLT/temp/dev3/reference0, /s0/ycchen/IWSLT/temp/dev3/reference1, /s0/ycchen/IWSLT/temp/dev3/reference2, /s0/ycchen/IWSLT/temp/dev3/reference3, /s0/ycchen/IWSLT/temp/dev3/reference4, /s0/ycchen/IWSLT/temp/dev3/reference5, /s0/ycchen/IWSLT/temp/dev3/reference6, /s0/ycchen/IWSLT/temp/dev3/reference7, /s0/ycchen/IWSLT/temp/dev3/reference8, /s0/ycchen/IWSLT/temp/dev3/reference9, /s0/ycchen/IWSLT/temp/dev3/reference10, /s0/ycchen/IWSLT/temp/dev3/reference11, /s0/ycchen/IWSLT/temp/dev3/reference12, /s0/ycchen/IWSLT/temp/dev3/reference13, /s0/ycchen/IWSLT/temp/dev3/reference14, /s0/ycchen/IWSLT/temp/dev3/reference15]: Sentence-by-Sentence Comparison

Sentence 0) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.6/0.25/0/0)

Source

��

�@

�i

��l

��

�H

Ref 0

Can

have

table?

Ref 1

you

have

any

tables

available?

Ref 2

Are

there

any

tables?

Ref 3

Can

you

put

somewhere?

Ref 4

you

have

table?

Ref 5

Can

get

table?

Ref 6

Could

seated?

Ref 7

you

have

any

tables?

Ref 8

Are

there

any

tables?

Ref 9

Are

any

tables

available?

Ref 10

Would

you

have

table?

Ref 11

Are

there

any

tables

available?

Ref 12

you

have

free

table?

Ref 13

Are

there

any

tables

available?

Ref 14

May

seated?

Ref 15

there

table

open?

Output 0

Give

table?

N-grams

Give	me	a	table?
		a	table?
		a table?

Output 1

give

table

can

N-grams

give	me	a	table	can	?
		a	table
		a table

Output 2

Give

table?

N-grams

Give	me	a	table?
		a	table?
		a table?

Output 3

Can

give

table?

N-grams

Can	give	me	a	table?
Can			a	table?
			a table?

Output 4

Can

give

table?

N-grams

Can	give	me	a	table?
Can			a	table?
			a table?

Sentence 1) BLEU: 0 (0.7143/0.3333/0.2/0) ; 0 (0.5/0/0/0) ; 0 (0.7143/0.3333/0.2/0) ; 0 (0.375/0/0/0) ; 0 (0.625/0/0/0)

Source

��

�@

��

�M�H

��

�C

Ref 0

Give

lighter

refill,

please.

Ref 1

Could

have

lighter

refill,

please?

Ref 2

Please

give

lighter

refill.

Ref 3

Can

get

lighter

refill,

please?

Ref 4

I'd

lighter

refill,

please.

Ref 5

Could

you

please

give

refill

for

lighter?

Ref 6

I'd

get

refill

for

lighter.

Ref 7

I'd

some

lighter

refill.

Ref 8

Could

you

give

some

lighter

refill,

please?

Ref 9

want

some

lighter

refill,

please.

Ref 10

May

have

lighter

refill?

Ref 11

lighter

refill,

please.

Ref 12

Could

you

get

lighter

refill?

Ref 13

Please

give

refill

for

lighter.

Ref 14

Give

lighter

fluid

refill

lighter,

please.

Ref 15

would

refill

for

lighter,

please.

Output 0

Please

give

for

light.

N-grams

Please	give	me	for	a	more	light.
Please	give	me	for	a
Please give
Please give me
	give me

Output 1

please

for

one

N-grams

please	me	for	more	one	.
please	me	for

Output 2

Please

give

for

light.

N-grams

Please	give	me	for	a	more	light.
Please	give	me	for	a
Please give
Please give me
	give me

Output 3

Please

change

one

for

simple

elegance.

N-grams

Please	change	one	for	me	more	simple	elegance.
Please			for	me

Output 4

Please

trade

one

lighter.

N-grams

Please	trade	one	to	me	to	be	lighter.
Please			to	me			lighter.

Sentence 2) BLEU: 1 (1/1/1/1) ; 0 (0.5714/0.3333/0.2/0) ; 1 (1/1/1/1) ; 0.7953 (1/0.8/0.75/0.6667) ; 0.7953 (1/0.8/0.75/0.6667)

Source

��

�Q

�h

�o��

�C

Ref 0

want

here.

Ref 1

I'd

here.

Ref 2

This

where

want

go.

Ref 3

I'd

this

place.

Ref 4

This

where

want

go.

Ref 5

want

this

place.

Ref 6

Here's

where

I'd

go.

Ref 7

I'd

here.

Ref 8

This

where

want

go.

Ref 9

Here's

where

want

go.

Ref 10

I'd

here.

Ref 11

This

where

want

go.

Ref 12

Here's

the

place

want

go.

Ref 13

would

get

here.

Ref 14

would

this

location.

Ref 15

would

this

place.

Output 0

want

here.

N-grams

I	want	to	go	here.
I	want	to	go	here.
I want		to go
I want to			go here.
I want to go
	want to
	want to go
	want to go here.
		to go here.

Output 1

want

here

N-grams

i	want	to	go	here	to	.
	want	to	go		to
	want to
	want to go
		to go

Output 2

want

here.

N-grams

I	want	to	go	here.
I	want	to	go	here.
I want		to go
I want to			go here.
I want to go
	want to
	want to go
	want to go here.
		to go here.

Output 3

want

here.

N-grams

I	want	to	go	to	here.
I	want	to	go	to	here.
I want		to go
I want to			go to
I want to go
	want to
	want to go
	want to go to
		to go to

Output 4

want

here.

N-grams

I	want	to	go	to	here.
I	want	to	go	to	here.
I want		to go
I want to			go to
I want to go
	want to
	want to go
	want to go to
		to go to

Sentence 3) BLEU: 0 (0.6667/0.2/0/0) ; 0 (0.8/0.5/0.3333/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0 (0.6667/0.2/0/0)

Source

��

�s

�O

��

�H

Ref 0

Which

wine

sweet?

Ref 1

you

have

any

sweet

wine?

Ref 2

Where

your

sweet

wine?

Ref 3

Could

you

tell

which

wine

sweet?

Ref 4

Which

sweeter

wine.

Ref 5

Which

wine

would

sweet

one?

Ref 6

Which

sweet

wine?

Ref 7

Which

sweet

wine?

Ref 8

Which

would

sweet

wine?

Ref 9

Can

you

recommend

sweet

wine?

Ref 10

Which

these

wines

are

sweet?

Ref 11

Which

one

sweet

wine?

Ref 12

Please

could

you

point

out

the

sweet

wine?

Ref 13

Which

these

wines

sweet?

Ref 14

Which

wines

are

sweet

ones?

Ref 15

Which

wine

not

dry?

Output 0

Which

kind

liquor

sweet?

N-grams

Which	kind	of	liquor	is	sweet?
Which		of		is	sweet?
				is sweet?

Output 1

which

wine

sweet

N-grams

which	wine	is	sweet	?
which	wine	is	sweet
which wine
which wine is
	wine is

Output 2

Which

wine

sweet?

N-grams

Which	wine	is	sweet?
Which	wine	is	sweet?
Which wine		is sweet?
Which wine is
Which wine is sweet?
	wine is
	wine is sweet?

Output 3

Which

wine

sweet?

N-grams

Which	wine	is	sweet?
Which	wine	is	sweet?
Which wine		is sweet?
Which wine is
Which wine is sweet?
	wine is
	wine is sweet?

Output 4

Which

kind

liquor

sweet?

N-grams

Which	kind	of	liquor	is	sweet?
Which		of		is	sweet?
				is sweet?

Sentence 4) BLEU: 0 (0.875/0.5333/0.1429/0) ; 0 (0.625/0.4286/0/0) ; 0 (0.875/0.5333/0.1429/0) ; 0 (0.9167/0.3636/0.1/0) ; 0 (0.5333/0.2857/0/0)

Source

��

�T�w

��

�Q��

��

��]

��

�L

�q��

�åB

��

�F

�w�w

�C

Ref 0

sure

that

called

the

hotel

yesterday

and

made

reservation.

Ref 1

surely

called

the

hotel

make

reservation

yesterday.

Ref 2

I'm

positive

phoned

the

hotel

book

room

yesterday.

Ref 3

certain

that

called

the

hotel

yesterday

and

reserved

room.

Ref 4

certain

that

called

the

hotel

yesterday

make

reservation.

Ref 5

Yesterday,

definitely

called

the

hotel

for

reservation.

Ref 6

Yesterday,

I'm

sure

called

the

hotel

for

booking.

Ref 7

I'm

positive

called

this

hotel

yesterday

and

made

reservations.

Ref 8

Yesterday

definitely

called

this

hotel

and

made

reservations.

Ref 9

I'm

certain

that

phoned

this

hotel

book

room

yesterday.

Ref 10

did

call

the

hotel

yesterday

for

reservation.

Ref 11

definitely

called

the

hotel

yesterday

make

reservation.

Ref 12

I'm

certain

that

called

the

hotel

yesterday

reserve

room.

Ref 13

certain

that

called

the

hotel

yesterday

and

reserved

room.

Ref 14

certain

that

yesterday

called

reservation

the

hotel.

Ref 15

positive

that

called

the

hotel

yesterday

and

reserved

room.

Output 0

I'm

sure

never

made

telephone

call

yesterday

the

hotel

and

make

reservation.

N-grams

I'm

sure

never

made

telephone

call

yesterday

the

hotel

and

make

reservation.

I'm

sure

made

call

yesterday

the

hotel

and

make

a reservation.

I'm sure

made a

yesterday to

the hotel

make a

reservation.

I'm sure I

hotel and

make a reservation.

sure I

Output 1

yesterday

the

hotel

and

N-grams

i	i	yesterday	to	the	hotel	and	.
		yesterday	to	the	hotel	and
		yesterday to		the hotel
					hotel and

Output 2

I'm

sure

never

made

telephone

call

yesterday

the

hotel

and

make

reservation.

N-grams

I'm

sure

never

made

telephone

call

yesterday

the

hotel

and

make

reservation.

I'm

sure

made

call

yesterday

the

hotel

and

make

a reservation.

I'm sure

made a

yesterday to

the hotel

make a

reservation.

I'm sure I

hotel and

make a reservation.

sure I

Output 3

certain

called

hotel

and

did

schedule

yesterday.

N-grams

I	am	certain	I	called	hotel	and	did	to	schedule	to	yesterday.
I	am	certain	I	called	hotel	and	did	to			yesterday.
I am			I called		hotel and
I am certain
	am certain

Output 4

determined

that

have

telephoned

yesterday

the

hotel

and

have

been

scheduled.

N-grams

determined

that

have

telephoned

yesterday

the

hotel

and

have

been

scheduled.

that

yesterday

the

hotel

and

that I

yesterday to

the hotel

hotel and

Sentence 5) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.3333/0/0/0) ; 0 (0.4/0.25/0/0)

Source

��

�U��

��

�K��

�C

Ref 0

See

the

note

below.

Ref 1

Look

the

note

below.

Ref 2

Refer

the

note

below.

Ref 3

See

note

below.

Ref 4

See

the

explanation

below.

Ref 5

See

the

annotation

below.

Ref 6

See

the

note

that

follows.

Ref 7

Please

see

note

below.

Ref 8

Comment

below.

Ref 9

See

note

below.

Ref 10

Read

the

following

note.

Ref 11

Check

the

note

below.

Ref 12

Look

the

note

underneath.

Ref 13

See

the

addendums

written

below.

Ref 14

Please

note

the

addendums

below.

Ref 15

Please

look

the

note

below.

Output 0

Watch

the

following

note.

N-grams

Watch	the	following	note.
	the	following	note.
	the following
	the following note.
		following note.

Output 1

the

following

memo

N-grams

the	following	memo	.
the	following
the following

Output 2

Watch

the

following

note.

N-grams

Watch	the	following	note.
	the	following	note.
	the following
	the following note.
		following note.

Output 3

See

nether

memo.

N-grams

See	nether	memo.
See

Output 4

Reads

the

following

informal

memo.

N-grams

Reads	the	following	informal	memo.
	the	following
	the following

Sentence 6) BLEU: 0 (0.6429/0.1538/0/0) ; 0 (0.3333/0.07143/0/0) ; 0 (0.6429/0.1538/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6667/0.07143/0/0)

Source

��

�F

�C

��

�ݭn

�~��

�b

�j�º�

��

�W

��

�h

��

�ɶ�

�H

Ref 0

see.

How

long

have

walk

Powell

Street?

Ref 1

OK.

How

long

will

take

walk

Powell

Street

from

here?

Ref 2

Alright.

How

long

the

walk

from

here

Powell

Street?

Ref 3

Right.

How

far

from

here

Powell

Street

foot?

Ref 4

OK.

How

long

should

walk

along

Powell

Street?

Ref 5

understand.

How

long

walk

along

Powell

Street?

Ref 6

All

right.

How

long

will

take

walk

along

Powell

Street?

Ref 7

Okay.

How

far

walk

down

Powell

Street?

Ref 8

that

right?

How

long

walk

down

Powell

Street?

Ref 9

that

so?

For

how

long

walk

Powell

Street?

Ref 10

Really?

How

far

should

walk

Powell

Street?

Ref 11

that

so?

How

far

down

Powell

Street

should

walk?

Ref 12

Okay.

How

much

have

down

Powell

Street?

Ref 13

see.

How

far

must

walk

along

Powell

Street?

Ref 14

see.

How

far

should

walk

along

Powell

Street?

Ref 15

see.

What

distance

should

walk

along

Powell

Street

for?

Output 0

understand.

need

continue

walk

the

streets

Powell

how

long?

N-grams

understand.

need

continue

walk

the

streets

Powell

how

long?

understand.

walk

the

Powell

how

I understand.

to walk

Output 1

need

continue

walk

the

powell

long

understood

street

time

N-grams

need

continue

walk

the

powell

long

understood

street

time

walk

the

long

to walk

Output 2

understand.

need

continue

walk

the

streets

Powell

how

long?

N-grams

understand.

need

continue

walk

the

streets

Powell

how

long?

understand.

walk

the

Powell

how

I understand.

to walk

Output 3

understood.

need

continue

Powell

the

street

walk

much

for

long

time?

N-grams

understood.

need

continue

Powell

the

street

walk

much

for

long

time?

Powell

the

walk

much

long

Output 4

understood.

need

continue

the

Powell

street

walk

the

long

time?

N-grams

understood.

need

continue

the

Powell

street

walk

the

long

time?

the

Powell

walk

long

to walk

Sentence 7) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.5/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.6/0.25/0/0) ; 0 (1/0.6667/0/0)

Source

�A

��

�N��

�O

��

�H

Ref 0

What

you

mean?

Ref 1

What

does

mean?

Ref 2

What

you

mean

that?

Ref 3

What

the

meaning

that?

Ref 4

What

are

you

saying?

Ref 5

What

does

that

mean?

Ref 6

What

are

you

trying

say?

Ref 7

What's

your

meaning?

Ref 8

What

that

supposed

mean?

Ref 9

What's

the

meaning

that?

Ref 10

Please

explain

this.

Ref 11

What

the

meaning

this?

Ref 12

Would

you

mind

explaining

this?

Ref 13

What

does

that

mean?

Ref 14

What

you

mean

say?

Ref 15

What

that

you

are

saying?

Output 0

you

mean

that?

N-grams

Do	you	mean	that?
	you	mean	that?
	you mean

Output 1

what

your

N-grams

what	is	your	?
	is	your

Output 2

you

mean

that?

N-grams

Do	you	mean	that?
	you	mean	that?
	you mean

Output 3

What

your

meanings

N-grams

What	is	your	meanings	?
What	is	your
What is

Output 4

What

your

meaning?

N-grams

What	is	your	meaning?
What	is	your	meaning?
What is		your meaning?

Sentence 8) BLEU: 0 (0.4167/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.4167/0/0/0) ; 0 (0.125/0/0/0)

Source

��

��о��

��

�n

�h

��

�ɶ�

�H

Ref 0

How

much

longer

will

take

get

Narita?

Ref 1

How

soon

will

get

Narita?

Ref 2

How

long

will

Narita?

Ref 3

How

long

will

take

get

Narita?

Ref 4

How

much

time

get

Narita?

Ref 5

How

much

longer

will

until

arrive

Narita?

Ref 6

How

much

time

before

arrive

Narita?

Ref 7

How

much

longer

Narita?

Ref 8

How

much

will

Narita?

Ref 9

How

much

you

estimate

before

arriving

Narita?

Ref 10

How

much

longer

for

Narita?

Ref 11

How

much

further

Narita?

Ref 12

How

far

now

Narita?

Ref 13

After

how

long

will

arrive

Narita?

Ref 14

How

much

time

until

arrive

Narita?

Ref 15

How

much

longer

until

reach

Narita?

Output 0

Get

Narita

airport

still

want

much

for

long

time?

N-grams

Get	to	Narita	airport	to	still	want	much	for	a	long	time?
	to			to			much	for		long

Output 1

narita

airport

long

time

N-grams

to	narita	airport	long	time	?
to			long	time

Output 2

Narita

Airport

but

also

how

long?

N-grams

To	Narita	Airport	but	also	how	long?
					how

Output 3

Get

Narita

Airport

still

want

much

for

long

time?

N-grams

Get	to	Narita	Airport	to	still	want	much	for	a	long	time?
	to			to			much	for		long

Output 4

the

Narita

airport

must

the

long

time?

N-grams

To	the	Narita	airport	must	the	long	time?
						long

Sentence 9) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0.6667/0/0/0) ; 0 (1/1/1/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.5/0.3333/0/0)

Source

�q��

�a

�F

�C

Ref 0

The

doesn't

work.

Ref 1

The

the

blink.

Ref 2

The

out

order.

Ref 3

Something

wrong

with

the

TV.

Ref 4

The

TV's

not

working.

Ref 5

The

won't

come

on.

Ref 6

The

won't

turn

on.

Ref 7

The

television

won't

turn

on.

Ref 8

The

doesn't

turn

on.

Ref 9

The

doesn't

on.

Ref 10

The

broken.

Ref 11

There

problem

with

the

TV.

Ref 12

The

won't

switch

on.

Ref 13

The

doesn't

turn

on.

Ref 14

The

not

working.

Ref 15

The

out

order.

Output 0

The

television

was

bad.

N-grams

The	television	was	bad.
The	television
The television

Output 1

the

television

N-grams

the	television	.
the	television

Output 2

broken.

N-grams

TV	is	broken.
TV	is	broken.
TV is
TV is broken.
	is broken.

Output 3

The

television

broke

down.

N-grams

The	television	broke	down.
The	television
The television

Output 4

The

television

was

bad.

N-grams

The	television	was	bad.
The	television
The television

Sentence 10) BLEU: 0 (0.1111/0/0/0) ; 0 (0.09091/0/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.1667/0.09091/0/0) ; 0 (0.1111/0/0/0)

Source

��

ı�o

��

��I

�C��

�C

Ref 0

feel

listless.

Ref 1

feel

sluggish.

Ref 2

don't

feel

well.

Ref 3

feel

languid.

Ref 4

body

feels

heavy.

Ref 5

don't

have

any

energy.

Ref 6

feel

I'm

dragging.

Ref 7

body

feels

achy.

Ref 8

I'm

achy.

Ref 9

have

energy.

Ref 10

body

feels

tired.

Ref 11

I'm

tired.

Ref 12

feel

weary.

Ref 13

body

feels

groggy.

Ref 14

body

feels

tired

and

heavy.

Ref 15

body

feels

languid.

Output 0

thought

that

the

mood

little

low.

N-grams

I	thought	that	the	mood	is	a	little	low.
I

Output 1

feel

bit

mood

that

the

little

low

N-grams

i	feel	a	bit	mood	that	the	is	little	low	.
	feel

Output 2

feel

bit

depressed

mood.

N-grams

I	feel	a	bit	depressed	mood.
I	feel
I feel

Output 3

feel

that

the

emotion

little

bit

low

fall.

N-grams

I	feel	that	the	emotion	is	a	little	bit	low	to	fall.
I	feel
I feel

Output 4

thought

that

the

mood

little

low.

N-grams

I	thought	that	the	mood	is	a	little	low.
I

Sentence 11) BLEU: 1 (1/1/1/1) ; 0 (0.75/0.4286/0.1667/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0.8409 (1/1/0.8333/0.6)

Source

��

�Q

�ݬ�

�o��

�C

Ref 0

I'd

see

this.

Ref 1

May

have

look

this?

Ref 2

Can

you

show

this?

Ref 3

Could

have

look

this?

Ref 4

want

take

look

this.

Ref 5

I'd

have

look

this.

Ref 6

want

check

this

out.

Ref 7

Could

take

look

this?

Ref 8

May

see

this?

Ref 9

want

take

look

this.

Ref 10

Would

you

mind

looked

this?

Ref 11

Could

take

look

this?

Ref 12

want

look

this.

Ref 13

you

don't

mind,

would

see

this.

Ref 14

want

see

this.

Ref 15

Could

you

show

this

me?

Output 0

want

take

look

this.

N-grams

I	want	to	take	a	look	at	this.
I	want	to	take	a	look	at	this.
I want		to take		a look		at this.
I want to			take a		look at
I want to take				a look at
	want to		take a look
	want to take			a look at this.
	want to take a				look at this.
		to take a
		to take a look
			take a look at

Output 1

want

look

this

N-grams

i	want	to	a	look	at	this	.
	want	to	a	look	at	this
	want to		a look
			a look at
				look at

Output 2

want

take

look

this.

N-grams

I	want	to	take	a	look	at	this.
I	want	to	take	a	look	at	this.
I want		to take		a look		at this.
I want to			take a		look at
I want to take				a look at
	want to		take a look
	want to take			a look at this.
	want to take a				look at this.
		to take a
		to take a look
			take a look at

Output 3

want

see

this.

N-grams

I	want	to	see	this.
I	want	to	see	this.
I want		to see
I want to			see this.
I want to see
	want to
	want to see
	want to see this.
		to see this.

Output 4

want

have

look

this.

N-grams

I	want	to	have	a	look	at	this.
I	want	to	have	a	look	at	this.
I want		to have		a look		at this.
I want to			have a		look at
	want to		have a look
		to have a			look at this.
		to have a look
			have a look at
				a look at
				a look at this.

Sentence 12) BLEU: 0 (1/1/1/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (1/1/1/0) ; 0 (0.5/0/0/0)

Source

��

�H

Ref 0

that

right?

Ref 1

Really?

Ref 2

Are

you

sure?

Ref 3

that

so?

Ref 4

Really?

Ref 5

that

so?

Ref 6

Oh?

Ref 7

that

so?

Ref 8

Really?

Ref 9

see.

Ref 10

that

correct?

Ref 11

Really?

Ref 12

that

so?

Ref 13

Really?

Ref 14

that

true?

Ref 15

Honestly?

Output 0

that

right?

N-grams

Is	that	right?
Is	that	right?
Is that
Is that right?
	that right?

Output 1

right

N-grams

right

Output 2

Did

not

you?

N-grams

Did

not

you?

Output 3

that

right?

N-grams

Is	that	right?
Is	that	right?
Is that
Is that right?
	that right?

Output 4

Such

right?

N-grams

Such	right?
	right?

Sentence 13) BLEU: 0 (1/0.6667/0.5/0) ; 0 (0.4/0/0/0) ; 0 (1/0.6667/0.5/0) ; 0 (0.2/0/0/0) ; 0 (0.75/0.3333/0/0)

Source

�L��

��

�ɭ�

��

�ǳ�

�n

�H

Ref 0

When

will

they

ready?

Ref 1

When

can

you

have

this

finished?

Ref 2

When

can

you

have

them

ready?

Ref 3

When

will

they

developed?

Ref 4

When

will

they

done?

Ref 5

When

can

you

have

them

for

me?

Ref 6

When

are

they

going

finished?

Ref 7

When

are

they

going

ready?

Ref 8

When

will

they

done?

Ref 9

How

long

before

they're

ready?

Ref 10

When

can

come

and

pick

them

up?

Ref 11

When

will

they

ready

for

pick

up?

Ref 12

When

will

they

done

by?

Ref 13

When

will

they

finished?

Ref 14

When

will

they

done?

Ref 15

When

going

ready?

Output 0

When

will

they

ready?

N-grams

When	will	they	ready?
When	will	they	ready?
When will
When will they
	will they

Output 1

when

they

can

prepare

N-grams

when	they	can	prepare	?
	they	can

Output 2

When

will

they

ready?

N-grams

When	will	they	ready?
When	will	they	ready?
When will
When will they
	will they

Output 3

They

when

can

prepare

good?

N-grams

They	when	can	prepare	good?
		can

Output 4

When

can

they

prepare?

N-grams

When	can	they	prepare?
When	can	they
When can

Sentence 14) BLEU: 0.2597 (0.5455/0.3/0.2222/0.125) ; 0 (0.6364/0.2/0.1111/0) ; 0.2597 (0.5455/0.3/0.2222/0.125) ; 0 (0.5833/0.1818/0/0) ; 0 (0.5/0.2308/0.08333/0)

Source

�A

��

�i�D

��

�b

�i�h�y

��

�a��

��

�A

��

�H

Ref 0

Can

you

tell

where

reach

you

Boston?

Ref 1

Can

you

tell

where

can

contact

you

Boston?

Ref 2

Tell

where

reach

you

Boston.

Ref 3

Could

you

tell

the

number

where

can

reach

you

Boston?

Ref 4

Can

you

give

your

contact

information

Boston?

Ref 5

Could

you

tell

how

get

hold

you

Boston?

Ref 6

Could

you

tell

how

can

contact

you

Boston?

Ref 7

Could

you

give

your

forwarding

address

Boston?

Ref 8

Please

tell

how

can

get

hold

you

Boston.

Ref 9

Would

you

give

details

where

reach

you

Boston?

Ref 10

Give

your

contact

details

Boston.

Ref 11

Please

tell

where

can

reach

you

Boston.

Ref 12

Could

have

your

contact

details

Boston?

Ref 13

Please

tell

how

get

hold

you

Boston?

Ref 14

May

get

your

contact

information

for

Boston?

Ref 15

Could

you

tell

where

can

contact

you

Boston?

Output 0

Can

you

tell

what

places

Boston

find

you?

N-grams

Can	you	tell	me	what	places	in	Boston	to	find	you?
Can	you	tell	me			in		to
Can you		tell me
Can you tell
Can you tell me
	you tell
	you tell me

Output 1

can

you

tell

what

boston

find

you

N-grams

can	you	tell	me	what	in	boston	to	find	you	?
can	you	tell	me		in		to		you
	you tell
	you tell me
		tell me

Output 2

Can

you

tell

what

places

Boston

find

you?

N-grams

Can	you	tell	me	what	places	in	Boston	to	find	you?
Can	you	tell	me			in		to
Can you		tell me
Can you tell
Can you tell me
	you tell
	you tell me

Output 3

You

can

tell

Boston

where

can

find

out

you?

N-grams

You	can	tell	me	in	Boston	of	where	can	find	out	you?
	can	tell	me	in		of	where
		tell me				of where

Output 4

What

place

could

you

tell

able

find

you

Boston's?

N-grams

What

place

could

you

tell

able

find

you

Boston's?

you

tell

you

you tell

you in

you tell me

tell me

Sentence 15) BLEU: 0.5411 (1/0.8571/0.5/0.2) ; 0 (0.4286/0.1667/0/0) ; 1 (1/1/1/1) ; 0.4317 (0.7778/0.625/0.4286/0.1667) ; 0.517 (0.625/0.5714/0.5/0.4)

Source

饻�j��]

��

�q�ܸ��X

�O

�h��

�H

Ref 0

What's

the

telephone

number

for

the

Japanese

Embassy?

Ref 1

you

know

the

number

for

the

Japanese

Embassy?

Ref 2

Can

you

tell

the

number

the

Japanese

Embassy?

Ref 3

Could

you

tell

the

Japanese

Embassy's

phone

number?

Ref 4

What's

the

Japanese

Embassy's

number?

Ref 5

What's

the

phone

number

the

Japanese

Embassy?

Ref 6

What

would

the

number

where

could

reach

the

Japanese

Embassy?

Ref 7

Could

you

give

the

number

for

the

Japanese

Embassy?

Ref 8

May

have

the

number

for

the

Japanese

Embassy?

Ref 9

What

would

the

number

for

the

Japanese

Embassy?

Ref 10

The

telephone

number

for

the

Japanese

Embassy,

please.

Ref 11

you

know

the

telephone

number

the

Japanese

Embassy?

Ref 12

Could

you

tell

the

telephone

number

for

the

Japanese

Embassy?

Ref 13

What

the

Japanese

Embassy's

telephone

number?

Ref 14

What

the

contact

number

for

the

Embassy

Japan?

Ref 15

Please

tell

the

telephone

number

for

the

Embassy

Japan.

Output 0

What

the

telephone

number

Japanese

Embassy?

N-grams

What	is	the	telephone	number	of	Japanese	Embassy?
What	is	the	telephone	number	of	Japanese	Embassy?
What is		the telephone		number of		Japanese Embassy?
What is the			telephone number
	is the		telephone number of
		the telephone number
		the telephone number of

Output 1

japanese

embassy

telephone

number

the

N-grams

japanese	embassy	's	telephone	number	the	?
			telephone	number	the
			telephone number

Output 2

Japanese

Embassy's

telephone

number?

N-grams

Japanese	Embassy's	telephone	number?
Japanese	Embassy's	telephone	number?
Japanese Embassy's		telephone number?
Japanese Embassy's telephone
Japanese Embassy's telephone number?
	Embassy's telephone
	Embassy's telephone number?

Output 3

What

the

telephone

number

Japanese

embassy

N-grams

What	is	the	telephone	number	of	Japanese	embassy	?
What	is	the	telephone	number	of	Japanese
What is		the telephone		number of
What is the			telephone number
	is the		telephone number of
		the telephone number
		the telephone number of

Output 4

How

many

are

the

Japanese

Embassy's

telephone

number?

N-grams

How	many	are	the	Japanese	Embassy's	telephone	number?
			the	Japanese	Embassy's	telephone	number?
			the Japanese		Embassy's telephone
			the Japanese Embassy's			telephone number?
			the Japanese Embassy's telephone
				Japanese Embassy's
				Japanese Embassy's telephone
				Japanese Embassy's telephone number?
					Embassy's telephone number?

Sentence 16) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.75/0.6667/0.5/0)

Source

�ڭ�

��

�ɭ�

�X�o

�H

Ref 0

What

time

should

leave?

Ref 1

wonder

when

need

leave?

Ref 2

What

time

have

leave?

Ref 3

you

know

the

time

need

leave?

Ref 4

What

time

should

go?

Ref 5

When

should

take

off?

Ref 6

What

time

should

depart?

Ref 7

When

should

leave?

Ref 8

wonder

what

time

should

go.

Ref 9

What

time

you

think

should

go?

Ref 10

When

would

good

time

leave?

Ref 11

When

should

off?

Ref 12

what

time

you

think

should

leave?

Ref 13

What

good

departure

time?

Ref 14

What

time

you

suggest

leave?

Ref 15

What

time

should

get

going?

Output 0

When

should

start?

N-grams

When	should	we	start?
When	should	we
When should
When should we
	should we

Output 1

when

should

N-grams

when	should	we	?
when	should	we
	should we

Output 2

When

should

start?

N-grams

When	should	we	start?
When	should	we
When should
When should we
	should we

Output 3

When

should

set

out?

N-grams

When	should	we	set	out?
When	should	we
When should
When should we
	should we

Output 4

When

should

embark?

N-grams

When	should	we	embark?
When	should	we
When should
When should we
	should we

Sentence 17) BLEU: 0 (0.5/0/0/0) ; 0 (0.5/0.4/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.5714/0/0/0)

Source

�A

�b

�o��

��

�Ʊ�

�H

Ref 0

What

your

business

here?

Ref 1

What

brought

you

here?

Ref 2

Why

have

you

come

here?

Ref 3

What's

the

purpose

your

visit

here?

Ref 4

What

your

purpose

for

coming

here?

Ref 5

What

the

purpose

your

visit?

Ref 6

What

the

reason

for

your

coming

here?

Ref 7

What

the

purpose

your

visit

here?

Ref 8

What

the

reason

for

your

visit?

Ref 9

Why

are

you

visiting?

Ref 10

What

brings

you

here?

Ref 11

What's

your

purpose

for

coming

here?

Ref 12

What

are

you

here

for?

Ref 13

What

the

reason

why

you

came?

Ref 14

What

did

you

come

here

do?

Ref 15

What

the

purpose

your

visit?

Output 0

Have

you

anything

here?

N-grams

Have	you	anything	here?
	you		here?

Output 1

have

you

here

what

N-grams

have	you	here	what	do	?
have	you	here
have you
	you here

Output 2

Have

you

anything

here?

N-grams

Have	you	anything	here?
	you		here?

Output 3

What

thing

you

have

here?

N-grams

What	thing	do	you	have	here?
What			you	have	here?

Output 4

What

matter

you

have

here?

N-grams

What	matter	do	you	have	in	here?
What			you	have		here?

Sentence 18) BLEU: 0 (0.4/0/0/0) ; 0 (0.75/0.2857/0.1667/0) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.4/0/0/0) ; 0 (0.4444/0/0/0)

Source

�b

�u�@��

�o

�a

��ƳB

��

�F

�H

Ref 0

Why

this

office

closed

weekday?

Ref 1

Why

isn't

this

office

open

weekdays?

Ref 2

Why

this

office

closed

weekday?

Ref 3

How

come

this

office

not

open

the

weekdays?

Ref 4

Why

this

office

closed

even

though

it's

weekday?

Ref 5

Why

would

this

office

closed

weekday?

Ref 6

How

come

it's

weekday

and

this

office

closed?

Ref 7

Why

would

this

office

closed

weekday?

Ref 8

What's

the

reason

for

this

office

being

closed

weekday?

Ref 9

What

would

the

reason

for

this

office

closing

weekday?

Ref 10

Why

would

this

office

closed

weekday?

Ref 11

What's

the

reason

for

this

office

closed

working

day?

Ref 12

Can

you

tell

why

this

office

closed

even

though

it's

weekday?

Ref 13

Why

the

bureau

closed

weekdays?

Ref 14

there

reason

why

this

office

closed

weekdays?

Ref 15

Why

the

office

not

open

weekday?

Output 0

Why

did

the

workday,

this

office,

the

door?

N-grams

At	Why	did	the	workday,	this	office,	close	the	door?
	Why		the		this

Output 1

working

this

office

closed

why

the

N-grams

in	working	this	office	closed	why	the	?
	working	this	office	closed	why	the
		this office
		this office closed
			office closed

Output 2

working

this

office

closed

why?

N-grams

In	working	in	this	office	closed	why?
	working		this	office	closed
			this office
			this office closed
				office closed

Output 3

why

did

the

workday,

this

office,

the

door?

N-grams

At	why	did	the	workday,	this	office,	close	the	door?
	why		the		this

Output 4

Closed

why

the

working

day

this

family

office?

N-grams

Closed	why	in	the	working	day	this	family	office?
	why		the	working		this

Sentence 19) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.2/0/0/0) ; 0 (0.2/0/0/0)

Source

�ߤW

�h��

��

�H

Ref 0

How

much

night?

Ref 1

How

much

does

cost

per

night?

Ref 2

How

much

room

each

night?

Ref 3

How

much

you

charge

night?

Ref 4

How

much

per

night?

Ref 5

How

much

for

one

night?

Ref 6

How

much

for

night?

Ref 7

How

much

per

night?

Ref 8

What

the

cost

per

night?

Ref 9

How

much

the

cost

per

night?

Ref 10

How

much

does

cost

per

night?

Ref 11

What

the

cost

per

night?

Ref 12

How

much

per

night?

Ref 13

How

much

stay

for

one

night?

Ref 14

How

much

per

day?

Ref 15

How

much

one

night?

Output 0

How

much

money

one

evening?

N-grams

How	much	money	one	evening?
How	much		one
How much

Output 1

how

much

money

one

evening

N-grams

how	much	money	one	evening	?
	much		one

Output 2

How

much

money

one

evening?

N-grams

How	much	money	one	evening?
How	much		one
How much

Output 3

One

night

how

much

N-grams

One	night	how	much	?
			much

Output 4

One

evening

how

much

money?

N-grams

One	evening	how	much	money?
			much

Sentence 20) BLEU: 0 (0.5/0.4/0.25/0) ; 0 (0.6667/0/0/0) ; 0 (0.5/0.4/0.25/0) ; 0 (0.5714/0/0/0) ; 0 (0.2857/0/0/0)

Source

�A

�b

��

�W

��

�ͬ�

��

�H

Ref 0

How

was

your

life

the

ship?

Ref 1

How

did

you

enjoy

your

time

the

ship?

Ref 2

What

did

you

think

your

time

the

ship?

Ref 3

What

was

your

time

the

ship?

Ref 4

How

were

things

onboard

the

ship?

Ref 5

What

was

life

the

ship?

Ref 6

What

was

living

the

ship?

Ref 7

How

was

living

the

ship?

Ref 8

How

did

you

find

living

the

ship?

Ref 9

What

was

living

the

ship?

Ref 10

How

was

your

ship

life?

Ref 11

What

was

live

the

ship?

Ref 12

How

did

you

find

life

the

ship?

Ref 13

What

was

your

lifestyle

the

ship?

Ref 14

What

was

living

the

ship?

Ref 15

What

was

traveling

the

ship?

Output 0

You

how

live

board?

N-grams

You	how	to	live	on	board?
		to	live	on
		to live
		to live on
			live on

Output 1

you

how

ship

life

N-grams

you	how	on	ship	life	?
you		on	ship	life

Output 2

You

how

live

board?

N-grams

You	how	to	live	on	board?
		to	live	on
		to live
		to live on
			live on

Output 3

You

ship

life

how?

N-grams

You	on	a	ship	of	life	how?
	on		ship	of	life

Output 4

You

are

what

kind

ship's

life?

N-grams

You	are	what	kind	on	ship's	life?
				on		life?

Sentence 21) BLEU: 0.3293 (0.7059/0.4375/0.2667/0.1429) ; 0 (0.6111/0.1176/0.0625/0) ; 0.183 (0.4706/0.25/0.1333/0.07143) ; 0.3293 (0.7059/0.4375/0.2667/0.1429) ; 0.1542 (0.6522/0.1818/0.09524/0.05)

Source

��

�M

��

�@�_

�Y

�ȶ�

��

�H

��

�b

��

��]

��

�o�{

�F

�@

�a

�n

�\�]

�C

Ref 0

How

about

having

lunch

with

some

day?

found

good

restaurant

near

hotel.

Ref 1

What

you

say

having

lunch

with

some

time?

saw

good

restaurant

near

hotel.

Ref 2

What

about

have

lunch

together

some

time?

discovered

good

restaurant

near

hotel.

Ref 3

How

would

you

have

lunch

with

some

day?

There's

nice

restaurant

found

near

hotel.

Ref 4

What

about

having

lunch

together

sometime?

found

good

restaurant

the

hotel.

Ref 5

Want

have

lunch

sometime?

I've

discovered

great

restaurant

around

the

hotel.

Ref 6

Shall

have

lunch

sometime?

I've

found

nice

restaurant

the

hotel.

Ref 7

How

about

lunch

together

one

day?

I've

discovered

good

restaurant

near

hotel.

Ref 8

Would

you

for

lunch

together

sometime?

There's

good

restaurant

I've

discovered

near

hotel.

Ref 9

you

want

for

lunch

together

sometime?

I've

found

nice

restaurant

the

hotel.

Ref 10

Shall

have

lunch

together

sometime?

noticed

that

there's

good

restaurant

near

hotel.

Ref 11

Would

you

have

lunch

together

sometime?

discovered

good

restaurant

just

hotel.

Ref 12

What

would

you

say

having

lunch

together

some

day?

found

out

that

there's

good

restaurant

round

hotel.

Ref 13

Some

day

would

you

have

lunch

together?

found

nice

restaurant

near

the

hotel.

Ref 14

How

about

lunch

together

sometime?

found

nice

restaurant

the

hotel.

Ref 15

How

about

eating

lunch

together

sometime?

found

nice

restaurant

the

hotel.

Output 0

Which

day

have

lunch

together

with

how?

found

good

restaurant

hotel

neighborhood.

N-grams

Which

day

have

lunch

together

with

how?

found

good

restaurant

hotel

neighborhood.

day

have

lunch

together

with

found

good

restaurant

have lunch

with me

I found

a good

have lunch together

I found a

good restaurant

lunch together

I found a good

found a

found a good

found a good restaurant

a good restaurant

Output 1

day

and

how

lunch

found

hotel

good

restaurant

which

have

together

N-grams

day

and

how

lunch

found

hotel

good

restaurant

which

have

together

day

lunch

found

good

restaurant

have

together

a good

a good restaurant

good restaurant

Output 2

Day

and

join

how

eat

lunch?

found

near

hotel

good

restaurant.

N-grams

Day

and

join

how

eat

lunch?

found

near

hotel

good

restaurant.

found

near

good

I found

near my

a good

I found near

I found near my

found near

found near my

Output 3

Which

day

have

lunch

together

with

how?

found

good

restaurant

hotel

neighborhood.

N-grams

Which

day

have

lunch

together

with

how?

found

good

restaurant

hotel

neighborhood.

day

have

lunch

together

with

found

good

restaurant

have lunch

with me

I found

a good

have lunch together

I found a

good restaurant

lunch together

I found a good

found a

found a good

found a good restaurant

a good restaurant

Output 4

Which

day

and

have

the

lunch

what

kind

together?

have

discovered

good

restaurant

nearby

mine

hotel.

N-grams

Which

day

and

have

the

lunch

what

kind

together?

have

discovered

good

restaurant

nearby

mine

hotel.

day

have

the

lunch

together?

discovered

good

restaurant

hotel.

together? I

discovered a

good restaurant

discovered a good

discovered a good restaurant

a good

a good restaurant

Sentence 22) BLEU: 1 (1/1/1/1) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0.7598 (0.8333/0.8/0.75/0.6667) ; 1 (1/1/1/1) ; 0 (0.3333/0.2/0/0)

Source

�A

��

��}

�A

��

�U�l

��

�H

Ref 0

Could

you

open

your

bag?

Ref 1

Would

you

open

your

bag?

Ref 2

Would

you

mind

opening

your

bag?

Ref 3

Would

you

open

your

bag

for

me?

Ref 4

Can

you

open

your

purse

for

me?

Ref 5

Could

you

open

your

handbag?

Ref 6

you

mind

opening

your

bag?

Ref 7

Open

your

bag,

please.

Ref 8

Would

you

open

your

bag,

please?

Ref 9

Can

you

open

the

bag

for

me?

Ref 10

Would

you

mind

opening

your

bag?

Ref 11

Please

open

your

bag.

Ref 12

Could

you

open

your

bag

for

me?

Ref 13

Would

you

mind

opening

your

bag

for

me?

Ref 14

May

ask

you

open

your

bag?

Ref 15

Could

you

open

your

bag?

Output 0

Can

you

open

your

bag?

N-grams

Can	you	open	your	bag?
Can	you	open	your	bag?
Can you		open your
Can you open			your bag?
Can you open your
	you open
	you open your
	you open your bag?
		open your bag?

Output 1

can

you

open

your

bag

N-grams

can	you	open	your	bag	?
	you	open	your	bag
	you open		your bag
	you open your
	you open your bag
		open your
		open your bag

Output 2

Can

you

open

your

bag

it?

N-grams

Can	you	open	your	bag	it?
Can	you	open	your	bag
Can you		open your
Can you open			your bag
Can you open your
	you open
	you open your
	you open your bag
		open your bag

Output 3

Can

you

open

your

bag?

N-grams

Can	you	open	your	bag?
Can	you	open	your	bag?
Can you		open your
Can you open			your bag?
Can you open your
	you open
	you open your
	you open your bag?
		open your bag?

Output 4

You

can

turn

your

bag?

N-grams

You	can	turn	on	your	bag?
				your	bag?
				your bag?

Sentence 23) BLEU: 0 (0.5/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.2222/0/0/0)

Source

��

�M

��

�H

Ref 0

How

about

drink?

Ref 1

What

you

say

drink?

Ref 2

Shall

for

drink?

Ref 3

What

about

going

out

for

drink?

Ref 4

Want

have

drink?

Ref 5

Shall

have

drink?

Ref 6

What

about

having

drink?

Ref 7

Would

you

drink?

Ref 8

Would

you

interested

having

drink?

Ref 9

Will

you

have

drink?

Ref 10

Shall

for

drink?

Ref 11

What

about

having

drink?

Ref 12

What

would

you

say

drink?

Ref 13

What

would

you

say

drink?

Ref 14

Would

you

for

drink?

Ref 15

May

suggest

for

drink?

Output 0

How

drink

like?

N-grams

How	to	drink	like?
How	to

Output 1

how

drink

cup

N-grams

how	to	drink	cup	?
	to

Output 2

How

drink

like?

N-grams

How	to	drink	like?
How	to

Output 3

Come

cup

beverage

how?

N-grams

Come	to	cup	beverage	how?
	to

Output 4

Comes

the

cup

drink

what

kind

of?

N-grams

Comes	the	cup	drink	to	be	what	kind	of?
				to	be

Sentence 24) BLEU: 0 (0.6667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0)

Source

��

�o

�F

�g�e

�C

Ref 0

have

diarrhea.

Ref 1

stomach

upset.

Ref 2

suffering

from

diarrhea.

Ref 3

I've

got

the

runs.

Ref 4

I've

got

Montezuma's

revenge.

Ref 5

have

the

trots.

Ref 6

have

the

runs.

Ref 7

I've

got

the

runs.

Ref 8

I've

got

diarrhea.

Ref 9

have

Delhi

belly.

Ref 10

I've

got

diarrhea.

Ref 11

I've

got

loose

bowels.

Ref 12

experiencing

diarrhea.

Ref 13

have

the

runs.

Ref 14

have

dysentery.

Ref 15

have

diarrhea.

Output 0

had

dysentery.

N-grams

I	had	dysentery.
I		dysentery.

Output 1

dysentery

N-grams

dysentery

Output 2

had

dysentery.

N-grams

I	had	dysentery.
I		dysentery.

Output 3

got

dysentery.

N-grams

I	got	dysentery.
I	got	dysentery.

Output 4

My	dysentery.

N-grams

My	dysentery.
My	dysentery.

Sentence 25) BLEU: 0.5946 (1/0.8333/0.6/0.25) ; 0 (0.6667/0.2/0/0) ; 0.5946 (1/0.8333/0.6/0.25) ; 0 (0.75/0.2857/0.1667/0) ; 0 (0.7143/0.3333/0.2/0)

Source

��

�Q

��

�@

��

�ӷP

�g

��

�C

Ref 0

I'd

have

allergy

test,

please.

Ref 1

Could

you

give

allergy

test,

please?

Ref 2

May

have

allergy

test,

please?

Ref 3

Can

you

allergy

test

me,

please?

Ref 4

I'd

you

run

allergy

test

me,

please.

Ref 5

want

have

test

for

allergies,

please.

Ref 6

I'd

you

test

for

allergies,

please.

Ref 7

Could

have

allergy

test,

please?

Ref 8

Please

allergy

test.

Ref 9

would

allergy

test

done,

please.

Ref 10

Could

have

allergy

test?

Ref 11

Would

you

mind

doing

allergy

test

me?

Ref 12

I'd

you

test

allergies

for

me.

Ref 13

would

you

check

for

allergies,

please.

Ref 14

Please

check

see

non-allergenic.

Ref 15

would

certain

don't

have

allergy

it.

Output 0

want

allergy

test.

N-grams

I	want	to	do	an	allergy	test.
I	want	to	do	an	allergy	test.
I want			do an		allergy test.
I want to			do an allergy
	want to		do an allergy test.
				an allergy
				an allergy test.

Output 1

want

test

N-grams

i	want	to	do	test	.
	want	to	do	test
	want to

Output 2

want

allergy

test.

N-grams

I	want	to	do	an	allergy	test.
I	want	to	do	an	allergy	test.
I want			do an		allergy test.
I want to			do an allergy
	want to		do an allergy test.
				an allergy
				an allergy test.

Output 3

want

sensitive

disease

test.

N-grams

I	want	to	do	a	sensitive	disease	test.
I	want	to	do	a			test.
I want
I want to
	want to

Output 4

want

make

sensitism

test.

N-grams

I	want	to	make	sensitism	to	test.
I	want	to			to	test.
I want
I want to
	want to

Sentence 26) BLEU: 0.4347 (0.7143/0.5/0.4/0.25) ; 0 (0.5714/0.5/0.2/0) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0.4347 (0.7143/0.5/0.4/0.25)

Source

�A

��

�ж�

��X

�O

�G

�@

�s

�C

Ref 0

Your

room

number

two

ten.

Ref 1

Your

room

number

two

ten.

Ref 2

The

number

your

room

two

ten.

Ref 3

Two

ten

your

room

number.

Ref 4

That

room

will

number

two-one-zero.

Ref 5

Your

room

number

going

two

hundred

and

ten.

Ref 6

Two-one-oh

your

room

number.

Ref 7

Room

number

two

ten.

Ref 8

You're

room

two

ten.

Ref 9

You'll

room

two

ten.

Ref 10

The

number

your

room

two

ten.

Ref 11

Two

ten

the

number

your

room.

Ref 12

You

are

room

number

two

ten.

Ref 13

You

are

staying

room

two

ten.

Ref 14

Your

room

two

ten.

Ref 15

Sir,

you

will

room

two

ten.

Output 0

Your

room

number

two

zero.

N-grams

Your	room	number	is	a	two	zero.
Your	room	number	is		two
Your room		number is
Your room number
Your room number is
	room number
	room number is

Output 1

your

room

number

zero

N-grams

your	room	number	is	21	zero	.
your	room	number	is
your room		number is
	room number
	room number is

Output 2

Your

room

number

N-grams

Your	room	number	is	21	0.
Your	room	number	is
Your room		number is
Your room number
Your room number is
	room number
	room number is

Output 3

Your

room

number

zero.

N-grams

Your	room	number	is	21	zero.
Your	room	number	is
Your room		number is
Your room number
Your room number is
	room number
	room number is

Output 4

Your

room

number

two

zero.

N-grams

Your	room	number	is	a	two	zero.
Your	room	number	is		two
Your room		number is
Your room number
Your room number is
	room number
	room number is

Sentence 27) BLEU: 0.7071 (1/0.8333/0.6/0.5) ; 0.4889 (0.8571/0.6667/0.4/0.25) ; 0 (0.75/0.6667/0.5/0) ; 1 (1/1/1/1) ; 0.7071 (1/0.8333/0.6/0.5)

Source

�A

�Q

�h

��

�H

Ref 0

Where

would

you

go?

Ref 1

Where

are

you

heading

for?

Ref 2

Where

you

want

go?

Ref 3

Where

your

destination?

Ref 4

Where

would

you

interested

going?

Ref 5

Where

you

feel

going?

Ref 6

Where

you

think

you'd

go?

Ref 7

Where

are

you

hoping

go?

Ref 8

Where

you

wish

go?

Ref 9

Where

are

you

headed?

Ref 10

Where

you

would

go?

Ref 11

Where

you

want

get

to?

Ref 12

Tell

where

you

would

go.

Ref 13

Where

may

take

you?

Ref 14

Where

would

you

taken?

Ref 15

what

direction

would

you

in?

Output 0

Where

you

want

to?

N-grams

Where	do	you	want	to	go	to?
Where	do	you	want	to	go	to?
Where do		you want		to go
Where do you			want to
Where do you want
	do you
	do you want
	do you want to
		you want to

Output 1

where

you

want

N-grams

where	do	you	want	to	go	?
where	do	you	want	to	go
	do you		want to
	do you want			to go
	do you want to
		you want
		you want to

Output 2

Where

you

want?

N-grams

Where	do	you	want?
Where	do	you
Where do
Where do you
	do you

Output 3

Where

you

want

go?

N-grams

Where	do	you	want	to	go?
Where	do	you	want	to	go?
Where do		you want		to go?
Where do you			want to
Where do you want
	do you		want to go?
	do you want
	do you want to
		you want to
		you want to go?

Output 4

Where

you

want

to?

N-grams

Where	do	you	want	to	go	to?
Where	do	you	want	to	go	to?
Where do		you want		to go
Where do you			want to
Where do you want
	do you
	do you want
	do you want to
		you want to

Sentence 28) BLEU: 1 (1/1/1/1) ; 0 (0.5/0.3333/0/0) ; 1 (1/1/1/1) ; 0 (0.6667/0/0/0) ; 0 (0/0/0/0)

Source

�{�b

�X�I

�F

�H

Ref 0

What

time

now?

Ref 1

you

have

the

time?

Ref 2

What

time

you

have?

Ref 3

Could

you

tell

the

time?

Ref 4

What's

the

current

time?

Ref 5

What's

the

time

right

now?

Ref 6

What

time

it?

Ref 7

What's

the

time

right

now?

Ref 8

Can

you

give

the

time?

Ref 9

Can

you

tell

what

time

now?

Ref 10

Could

you

tell

the

time

now?

Ref 11

The

time

now,

please.

Ref 12

Have

you

got

the

time

right

now?

Ref 13

What

the

present

time?

Ref 14

What

time

present?

Ref 15

What

time

it?

Output 0

What

time

it?

N-grams

What	time	is	it?
What	time	is	it?
What time		is it?
What time is
What time is it?
	time is
	time is it?

Output 1

what

time

now

N-grams

what	time	now	?
what	time
what time

Output 2

What

time

it?

N-grams

What	time	is	it?
What	time	is	it?
What time		is it?
What time is
What time is it?
	time is
	time is it?

Output 3

Now

what

time?

N-grams

Now	what	time?
	what	time?

Output 4

Now

how

many?

N-grams

Now

how

many?

Sentence 29) BLEU: 0 (0.6667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.6667/0/0/0)

Source

��

�ۤv

��

�C

��

�C

Ref 0

I'll

take

myself.

Thanks.

Ref 1

can

take

myself.

Thanks

anyway.

Ref 2

can

carry

myself.

Thank

you.

Ref 3

can

manage

myself.

Thanks.

Ref 4

I'll

get

myself.

Thank

you.

Ref 5

I'll

take

care

myself.

Thanks.

Ref 6

I'll

manage

myself.

Thanks.

Ref 7

I'll

bring

that

myself.

Thank

you.

Ref 8

I'm

going

bring

myself.

Thanks.

Ref 9

can

take

myself.

Many

thanks.

Ref 10

I'll

carry

myself.

Thanks

anyway.

Ref 11

can

manage

carry

myself.

Very

kind

you

offer.

Ref 12

I'll

able

carry

alone.

Thank

you.

Ref 13

will

carry

myself.

Thanks.

Ref 14

will

get

it.

Thanks.

Ref 15

will

carry

myself.

Thanks.

Output 0

come.

Thanks.

N-grams

I	come.	Thanks.
I		Thanks.

Output 1

come

N-grams

come

Output 2

have

to.謝謝.

N-grams

I	have	to.謝謝.
I

Output 3

Myself

come.

Thank.

N-grams

Myself

come.

Thank.

Output 4

come.

Thanks.

N-grams

I	come.	Thanks.
I		Thanks.

Sentence 30) BLEU: 0 (0.5714/0.1667/0/0) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.5714/0.1667/0/0) ; 0.4347 (0.7143/0.5/0.4/0.25) ; 0 (0.5/0.1429/0/0)

Source

��M

�i�H

�C

��

�@

��

�H

Ref 0

Sure.

Can

have

receipt?

Ref 1

course.

Could

you

give

receipt?

Ref 2

Certainly.

Would

you

provide

with

receipt?

Ref 3

OK.

possible

get

receipt?

Ref 4

Yes.

Could

get

the

receipt?

Ref 5

OK.

May

have

the

receipt?

Ref 6

Right.

The

receipt,

please?

Ref 7

course.

Can

you

give

receipt?

Ref 8

Okay.

May

have

receipt?

Ref 9

Yes.

I'd

receipt,

please.

Ref 10

That's

right.

I'd

receipt.

Ref 11

Yes.

receipt

please.

Ref 12

Indeed.

Could

you

give

receipt?

Ref 13

Yes.

May

have

receipt?

Ref 14

Yes.

possible

get

the

receipt?

Ref 15

Yes.

Please

give

the

receipt.

Output 0

Certainly.

Give

receipt

for

it?

N-grams

Certainly.	Give	me	a	receipt	for	it?
Certainly.		me	a	receipt
		me a

Output 1

certainly

give

receipt

can

N-grams

certainly	give	me	a	receipt	can	?
	give	me	a	receipt
	give me
	give me a
		me a

Output 2

Certainly.

Give

receipt

for

it?

N-grams

Certainly.	Give	me	a	receipt	for	it?
Certainly.		me	a	receipt
		me a

Output 3

Certainly

can.

Can

give

receipt?

N-grams

Certainly	can.	Can	give	me	a	receipt?
		Can	give	me	a	receipt?
			give me		a receipt?
			give me a
			give me a receipt?
				me a
				me a receipt?

Output 4

Certainly

may.

Can

give

informal

receipt?

N-grams

Certainly	may.	Can	give	me	an	informal	receipt?
		Can	give	me			receipt?
			give me

Sentence 31) BLEU: 0 (1/1/0.6/0) ; 0 (0.75/0.7143/0.3333/0) ; 0 (1/1/0.6/0) ; 0 (0.625/0.2857/0.1667/0) ; 0 (0.875/0.7143/0.3333/0)

Source

��

�Q

��

�@�U

��a

��s

�C

Ref 0

I'd

try

some

local

wine.

Ref 1

Can

try

some

local

wine?

Ref 2

you

have

any

local

wine

can

try?

Ref 3

I'd

taste

some

the

local

wine.

Ref 4

want

give

the

local

wine

try.

Ref 5

I'd

see

how

the

regional

wine

is.

Ref 6

I'd

try

some

the

wine

from

this

area.

Ref 7

was

hoping

try

some

local

wine.

Ref 8

Could

try

local

wine?

Ref 9

I'm

interested

trying

local

wine.

Ref 10

want

taste

the

local

wine.

Ref 11

It'd

nice

taste

some

local

wine.

Ref 12

I'm

interested

trying

out

the

local

wine.

Ref 13

would

try

the

wine

from

around

this

area.

Ref 14

would

taste

the

local

wine?

Ref 15

would

the

wine

that's

made

locally.

Output 0

want

try

the

local

wine.

N-grams

I	want	to	try	the	local	wine.
I	want	to	try	the	local	wine.
I want		to try		the local
I want to			try the		local wine.
	want to			the local wine.
		to try the

Output 1

want

try

the

local

wine

N-grams

i	want	to	try	the	local	wine	.
	want	to	try	the	local	wine
	want to		try the		local wine
		to try		the local
		to try the
				the local wine

Output 2

want

try

the

local

wine.

N-grams

I	want	to	try	the	local	wine.
I	want	to	try	the	local	wine.
I want		to try		the local
I want to			try the		local wine.
	want to			the local wine.
		to try the

Output 3

want

take

shot

native

wine.

N-grams

I	want	to	take	a	shot	native	wine.
I	want	to		a			wine.
I want
I want to
	want to

Output 4

want

try

the

local

grape

wine.

N-grams

I	want	to	try	the	local	grape	wine.
I	want	to	try	the	local		wine.
I want		to try		the local
I want to			try the
	want to
		to try the

Sentence 32) BLEU: 0 (0.5556/0.375/0/0) ; 0 (0.375/0/0/0) ; 0 (0.6667/0.375/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.5556/0.375/0/0)

Source

�ڭ�

�i��

�F

�@

��

�I��

��G

��

�Q��

�A

��O

��

�H

Ref 0

We've

had

very

productive

discussion,

haven't

we?

Ref 1

That

was

fruitful

discussion,

wasn't

it?

Ref 2

Don't

you

think

that

was

good

discussion?

Ref 3

think

that

discussion

was

very

productive,

don't

you?

Ref 4

We've

had

some

very

fruitful

talks,

haven't

we?

Ref 5

We've

certainly

had

some

constructive

exchanges,

haven't

we?

Ref 6

have

really

had

useful

dialog,

haven't

we?

Ref 7

Our

discussion

was

very

productive,

wasn't

it?

Ref 8

That

was

very

productive

discussion

that

had,

wasn't

it?

Ref 9

Wouldn't

you

say

that

had

very

productive

discussion?

Ref 10

What

productive

discussion

had.

Ref 11

Don't

you

think

had

very

productive

discussion?

Ref 12

Our

discussion

was

very

productive,

wasn't

it?

Ref 13

had

meaty

discussion,

didn't

we?

Ref 14

covered

lot

ground

our

discussion,

didn't

we?

Ref 15

expressed

lot

our

discussion,

didn't

we?

Output 0

have

carried

productive

discussion,

not

right?

N-grams

We	have	carried	on	a	productive	discussion,	not	right?
We	have			a	productive	discussion,
We have				a productive
					productive discussion,

Output 1

discussion

not

carried

N-grams

we	a	discussion	,	not	carried	on	?
we	a	discussion

Output 2

conducted

very

fruitful

discussion,

not

it?

N-grams

We	conducted	a	very	fruitful	discussion,	is	not	it?
We		a	very	fruitful	discussion,			it?
		a very		fruitful discussion,
			very fruitful

Output 3

carried

discussion

being

rich

with

the

result

once,

not?

N-grams

carried

discussion

being

rich

with

the

result

once,

not?

discussion

Output 4

have

carried

productive

discussion,

not

right?

N-grams

We	have	carried	on	a	productive	discussion,	not	right?
We	have			a	productive	discussion,
We have				a productive
					productive discussion,

Sentence 33) BLEU: 0 (0.5/0.2/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.5/0.2/0/0) ; 0.5081 (0.6667/0.6/0.5/0.3333)

Source

�{�b

��

�@

��

�B�~

�O

�C

Ref 0

There

surcharge

this

time.

Ref 1

There

surcharge

levied

during

this

time

period.

Ref 2

During

this

time

period

surcharge

levied.

Ref 3

surcharge

levied

during

this

time

period.

Ref 4

present,

there

surcharge.

Ref 5

Currently,

there

additional

charge.

Ref 6

During

this

period

time,

there

supplemental

fee.

Ref 7

Special

rates

apply

during

this

period.

Ref 8

Extra

charges

apply

during

this

period.

Ref 9

surcharge

rate

applicable

during

this

period.

Ref 10

this

time

the

price

higher.

Ref 11

You

have

pay

extra

during

this

time.

Ref 12

You'll

have

pay

this

time.

Ref 13

this

particular

time,

there

extra

charge.

Ref 14

You

must

pay

extra

for

this

particular

time

period.

Ref 15

You

must

pay

extra

charge

for

this

time

period.

Output 0

There

has

additional

fee

now.

N-grams

There	has	an	additional	fee	now.
There		an	additional
		an additional

Output 1

now

there

additional

fee

N-grams

now	there	an	additional	fee	.
	there	an	additional
		an additional

Output 2

Now

there

are

additional

fee.

N-grams

Now	there	are	an	additional	fee.
	there		an	additional	fee.
			an additional

Output 3

There

has

additional

fee

now.

N-grams

There	has	an	additional	fee	now.
There		an	additional
		an additional

Output 4

Now

there

extra

outlay.

N-grams

Now	there	is	an	extra	outlay.
	there	is	an	extra
	there is		an extra
	there is an
	there is an extra
		is an
		is an extra

Sentence 34) BLEU: 0 (0.6667/0.4/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.6667/0.4/0/0) ; 0 (0.4/0/0/0)

Source

��

�q

�o��

�i�J

��

�H

Ref 0

May

butt

here?

Ref 1

May

interrupt

here?

Ref 2

Would

you

mind

talk

now?

Ref 3

May

have

word?

Ref 4

Could

interrupt

here?

Ref 5

May

interject

something

this

point?

Ref 6

Could

get

word

now?

Ref 7

you

mind

say

something?

Ref 8

Can

say

something

here?

Ref 9

Could

tell

you

what

think

here?

Ref 10

you

mind

butt

in?

Ref 11

Can

just

say

something?

Ref 12

Could

interrupt

you

second?

Ref 13

May

interrupt

for

moment?

Ref 14

May

just

say

word

here?

Ref 15

May

squeeze

word?

Output 0

Can

get

into

from

here?

N-grams

Can	I	get	into	from	here?
Can	I	get			here?
Can I
	I get

Output 1

can

here

enter

from

N-grams

can

here

enter

from

Output 2

can

here

enter

it?

N-grams

I	can	here	to	enter	it?
I

Output 3

Can

get

into

from

here?

N-grams

Can	I	get	into	from	here?
Can	I	get			here?
Can I
	I get

Output 4

can

enter

from

here?

N-grams

I	can	enter	from	here?
I				here?

Sentence 35) BLEU: 0 (0.8/0.3333/0.25/0) ; 0 (0.6667/0.1818/0.1/0) ; 0 (0.8/0.3333/0.25/0) ; 0 (0.5/0.2727/0.1/0) ; 0 (0.6667/0.2727/0/0)

Source

��

�]

�P

�F��

�M

�@

��

�g��

�@�_

��

�C

Ref 0

That

also

comes

with

salad

and

choice

potatoes.

Ref 1

That

includes

salad

with

your

choice

potatoes.

Ref 2

salad

and

potatoes

are

included

with

that.

Ref 3

salad

and

potatoes

come

with

that.

Ref 4

salad

and

your

choice

potatoes

also

included

with

that.

Ref 5

That

also

accompanied

salad

and

whatever

potatoes

you

choose.

Ref 6

Along

with

that,

you

also

get

salad

and

the

potatoes

your

choice.

Ref 7

You

also

get

salad

with

that

and

choice

potatoes.

Ref 8

salad

and

your

choice

potatoes

also

come

with

that.

Ref 9

There's

also

salad

with

that

and

your

choice

potatoes.

Ref 10

That

also

accompanied

salad

and

your

choice

potatoes.

Ref 11

That

too

served

with

salad

and

choice

potatoes.

Ref 12

Salad

also

comes

with

that

dish,

and

you

can

choose

your

style

potato.

Ref 13

That

includes

salad

and

your

choice

potato.

Ref 14

That

also

includes

salad

and

choice

potato.

Ref 15

There's

also

salad

and

choice

potato

with

that.

Output 0

That

with

salad

and

potatoes

together

with

the

supply.

N-grams

That	with	a	salad	and	potatoes	together	with	the	supply.
That	with	a	salad	and	potatoes			the
		a salad		and potatoes
		a salad and
			salad and
			salad and potatoes

Output 1

that

with

salad

and

together

the

supply

also

kind

N-grams

that	with	a	salad	and	together	the	supply	also	kind	of	.
that	with	a	salad	and		the		also		of
		a salad
		a salad and
			salad and

Output 2

That

with

salad

and

potatoes

together

with

the

supply.

N-grams

That	with	a	salad	and	potatoes	together	with	the	supply.
That	with	a	salad	and	potatoes			the
		a salad		and potatoes
		a salad and
			salad and
			salad and potatoes

Output 3

That

also

together

salad

and

kind

soil

bean

supply

together.

N-grams

That	also	together	salad	and	a	kind	of	soil	bean	supply	together.
That	also		salad	and	a		of
That also			salad and
			salad and a
				and a

Output 4

That

also

supplies

together

with

the

salad

and

one

kind

potato.

N-grams

That	also	supplies	together	with	the	salad	and	one	kind	of	potato.
That	also			with	the	salad	and			of	potato.
That also						salad and				of potato.

Sentence 36) BLEU: 0.8091 (0.8571/0.8333/0.8/0.75) ; 0 (0.4/0/0/0) ; 0 (0.2/0/0/0) ; 0.8091 (0.8571/0.8333/0.8/0.75) ; 0 (0.25/0/0/0)

Source

�A

��

�o

�}��

��

�H

Ref 0

Did

you

have

fun

today?

Ref 1

Did

you

enjoy

yourself

today?

Ref 2

Did

you

have

good

time

today?

Ref 3

Was

fun

today?

Ref 4

Did

you

have

good

time

today?

Ref 5

Was

fun

day?

Ref 6

Did

you

enjoy

yourself

today?

Ref 7

Was

fun

today?

Ref 8

Did

you

enjoy

yourself

today?

Ref 9

Did

you

have

good

time

today?

Ref 10

Did

you

enjoy

yourself

today?

Ref 11

Was

fun

today?

Ref 12

Was

fun

day

today?

Ref 13

Was

fun

today?

Ref 14

Did

you

enjoy

yourself

today?

Ref 15

Did

you

have

good

time

today?

Output 0

you

have

good

time

today?

N-grams

Do	you	have	a	good	time	today?
	you	have	a	good	time	today?
	you have		a good		time today?
	you have a			good time
	you have a good
		have a		good time today?
		have a good
		have a good time
			a good time
			a good time today?

Output 1

have

today

you

N-grams

have	today	do	you	?
have			you

Output 2

Have

fun

today,

you?

N-grams

Have	fun	today,	do	you?
	fun

Output 3

you

have

good

time

today?

N-grams

Do	you	have	a	good	time	today?
	you	have	a	good	time	today?
	you have		a good		time today?
	you have a			good time
	you have a good
		have a		good time today?
		have a good
		have a good time
			a good time
			a good time today?

Output 4

You

play

happily

today?

N-grams

You	play	happily	today?
			today?

Sentence 37) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.5/0.3333/0/0)

Source

��

�Ĥl

��

�馩

��

�H

Ref 0

there

discount

for

children?

Ref 1

you

have

children's

discount?

Ref 2

Can't

get

discount

for

children?

Ref 3

Are

there

any

discounts

for

children?

Ref 4

you

have

children's

discount?

Ref 5

you

take

anything

off

for

children?

Ref 6

you

have

lower

rate

for

kids?

Ref 7

you

have

discounts

for

children?

Ref 8

Are

discounts

available

for

children?

Ref 9

Have

you

any

discounts

for

children?

Ref 10

children

get

discount?

Ref 11

Can

children

receive

discount?

Ref 12

cheaper

for

children?

Ref 13

cheaper

for

children?

Ref 14

there

discount

price

for

children?

Ref 15

there

cheaper

price

for

children

available?

Output 0

Have

the

children's

discount?

N-grams

Have	to	the	children's	discount?
Have			children's	discount?
			children's discount?

Output 1

have

the

children

discount

N-grams

have	the	children	's	discount	to	?
have		children		discount

Output 2

Have

the

children's

discount?

N-grams

Have	on	the	children's	discount?
Have			children's	discount?
			children's discount?

Output 3

Have

the

children's

discount?

N-grams

Have	to	the	children's	discount?
Have			children's	discount?
			children's discount?

Output 4

Has

children's

discount?

N-grams

Has	to	children's	discount?
		children's	discount?
		children's discount?

Sentence 38) BLEU: 0 (0.4286/0/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.4286/0/0/0)

Source

�I��

��

�ɶ�

�O

��

�ɭ�

�H

Ref 0

What

time

check-out?

Ref 1

What

time

have

check

out?

Ref 2

What

time

check

out?

Ref 3

What

time

need

check

out?

Ref 4

What's

the

check-out

time?

Ref 5

When's

check

out?

Ref 6

What

time

should

checked

out

by?

Ref 7

When

check-out?

Ref 8

When

check-out

time?

Ref 9

What

time

have

check-out?

Ref 10

What

time

have

check

out?

Ref 11

When

check-out?

Ref 12

What's

the

check-out

time?

Ref 13

When

check-out

time?

Ref 14

What

time

have

check

out?

Ref 15

When

check

out?

Output 0

Pays

bill

when

the

time?

N-grams

Pays	a	bill	when	is	the	time?
				is	the	time?

Output 1

time

when

bill

N-grams

time	is	when	a	bill	?
time	is
time is

Output 2

Payment

time

when?

N-grams

Payment	time	is	when?
	time	is
	time is

Output 3

Time

paying

bill

when?

N-grams

Time	of	paying	a	bill	is	when?
					is

Output 4

Pays

bill

when

the

time?

N-grams

Pays	a	bill	when	is	the	time?
				is	the	time?

Sentence 39) BLEU: 0 (0.6/0.5/0.3333/0) ; 0 (0.75/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.2/0/0/0)

Source

�u

�ݭn

��

�@�U

�o��

�C

Ref 0

Just

press

here.

Ref 1

Just

push

here,

please.

Ref 2

Press

this

button,

please.

Ref 3

All

you

have

press

here.

Ref 4

Just

push

here.

Ref 5

Just

hold

this

down

here.

Ref 6

You

only

have

push

here.

Ref 7

All

you

have

press

here.

Ref 8

Simply

press

here.

Ref 9

You

only

have

push

here.

Ref 10

You

just

need

press

here.

Ref 11

Press

here

and

that's

it.

Ref 12

All

you

have

press

here.

Ref 13

You

only

have

press

here.

Ref 14

Just

push

this

here.

Ref 15

Just

push

here.

Output 0

Only

need

press

this.

N-grams

Only	need	to	press	this.
	need	to	press
	need to
	need to press
		to press

Output 1

this

only

N-grams

this	only	to	.
this	only	to

Output 2

Simply

click

this.

N-grams

Simply	click	on	this.
Simply

Output 3

Only

need

press

this.

N-grams

Only	need	to	press	this.
	need	to	press
	need to
	need to press
		to press

Output 4

Only

needs

according

this.

N-grams

Only	needs	according	to	this.
			to

Sentence 40) BLEU: 0.3156 (0.5556/0.375/0.2857/0.1667) ; 0 (0.7143/0.3333/0.2/0) ; 0.3156 (0.5556/0.375/0.2857/0.1667) ; 0 (0.625/0.4286/0.1667/0) ; 0 (0.5714/0.1667/0/0)

Source

�q��

�`��

�O

�K�O

��

�٬O

�B�~

��O

��

�H

Ref 0

the

video

program

free

does

cost

extra?

Ref 1

you

charge

for

videos

not?

Ref 2

have

pay

for

the

video?

Ref 3

the

video

for

free,

have

pay?

Ref 4

have

pay

for

the

video

free?

Ref 5

the

video

free

charge,

have

pay?

Ref 6

the

video

charge

pay

for

it?

Ref 7

free

for

videos

there

charge?

Ref 8

Are

videos

free

will

there

charge?

Ref 9

charge

for

videos

there

fee?

Ref 10

Can

watch

the

video

for

free

need

pay

for

it?

Ref 11

the

video

free

not?

Ref 12

have

pay

for

the

video,

get

free?

Ref 13

the

video

free

there

extra

charge?

Ref 14

the

video

free

charge

does

cost

extra?

Ref 15

the

video

free

must

pay

see

it?

Output 0

Television

programs

are

free

charge

additional

charge?

N-grams

Television	programs	are	free	of	charge	or	additional	charge?
			free	of	charge	or		charge?
			free of		charge or
			free of charge
			free of charge or
				of charge
				of charge or

Output 1

television

free

the

program

N-grams

television	free	or	is	the	program	?
	free	or	is	the	program
	free or
	free or is
		or is

Output 2

Television

programs

are

free

charge

additional

charge?

N-grams

Television	programs	are	free	of	charge	or	additional	charge?
			free	of	charge	or		charge?
			free of		charge or
			free of charge
			free of charge or
				of charge
				of charge or

Output 3

the

television

program

free

additionally

charges?

N-grams

Is	the	television	program	free	or	additionally	charges?
Is	the		program	free	or
Is the			program free
			program free or
				free or

Output 4

The

television

program

free

overcharges?

N-grams

The	television	program	is	free	or	overcharges?
		program	is	free	or
				free or

Sentence 41) BLEU: 0 (0.8889/0.625/0.2857/0) ; 0 (0.7/0.3333/0.125/0) ; 0 (0.8889/0.625/0.2857/0) ; 0 (0.375/0.06667/0/0) ; 0.234 (0.4286/0.3077/0.25/0.09091)

Source

��

�b

��

�@��

�~

�G

�M

�w��

��

�ֽ�

��

�C

Ref 0

I'm

looking

for

some

lotion

and

emulsifier

for

dry

skin.

Ref 1

I'm

trying

find

some

lotion

and

emulsifier

for

dry

skin.

Ref 2

I'm

looking

for

lotion

and

emulsifier

for

dry

skin.

Ref 3

I'm

hoping

find

some

dry

skin

lotion

and

toner.

Ref 4

want

find

some

lotion

and

some

clarifying

lotion

for

chapped

skin.

Ref 5

I'm

looking

for

some

lotion

and

toner

use

dry

skin.

Ref 6

I'm

trying

find

some

lotion

and

moisturizer

for

dry

skin.

Ref 7

want

get

some

lotion

and

moisturizer

for

dry

skin.

Ref 8

Can

you

help

find

some

skin

lotion

and

moisturizer

for

dry

skin?

Ref 9

would

buy

some

lotion

and

emulsifier

soften

dry

skin.

Ref 10

I'm

trying

find

some

lotion

and

emulsifier

for

dry

skin.

Ref 11

want

some

lotion

and

emulsifier

help

dry

skin.

Ref 12

looking

for

skin

milk

and

toner

for

dry

skin.

Ref 13

looking

for

light

skin

lotion

and

toner

meant

for

dry

skin.

Ref 14

searching

for

lotion

and

toner

for

dry

skin

types.

Ref 15

I'm

looking

for

some

lotion

and

emulsifier

for

dry

skin.

Output 0

find

some

lotion

for

dry

skin

and

emulsifier.

N-grams

I	find	some	lotion	for	dry	skin	and	emulsifier.
I	find	some	lotion	for	dry	skin	and
	find some		lotion for		dry skin
	find some lotion			for dry
		some lotion		for dry skin

Output 1

some

for

dry

skin

and

emulsifier

N-grams

i	some	for	dry	skin	and	emulsifier	am	of	.
	some	for	dry	skin	and	emulsifier	am
		for dry			and emulsifier
		for dry skin
			dry skin

Output 2

find

some

lotion

for

dry

skin

and

emulsifier.

N-grams

I	find	some	lotion	for	dry	skin	and	emulsifier.
I	find	some	lotion	for	dry	skin	and
	find some		lotion for		dry skin
	find some lotion			for dry
		some lotion		for dry skin

Output 3

finding

some

wash

liquid

and

aim

dry

sex

skin

emulsify.

N-grams

finding

some

wash

liquid

and

aim

dry

sex

skin

emulsify.

some

and

dry

skin

I am

Output 4

looking

for

some

cleaning

solutions

and

view

skin's

emulsifier.

N-grams

looking

for

some

cleaning

solutions

and

view

skin's

emulsifier.

looking

for

some

and

I am

looking for

I am looking

for some

I am looking for

am looking

am looking for

looking for some

Sentence 42) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.6/0.25/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.1667/0/0/0) ; 0 (0.6/0.5/0.3333/0)

Source

��

�h

��

�@��

�馩

�C

Ref 0

Please

give

discount.

Ref 1

Can't

you

make

cheaper?

Ref 2

Can't

have

larger

discount?

Ref 3

Please

give

larger

discount.

Ref 4

Could

you

give

cheaper

price?

Ref 5

Can

you

please

make

cheaper?

Ref 6

Could

you

come

down

little

more?

Ref 7

Could

you

give

better

deal?

Ref 8

Could

you

down

little

more?

Ref 9

How

about

little

discount?

Ref 10

Can

have

better

discount?

Ref 11

I'd

better

discount.

Ref 12

Can't

you

make

even

cheaper?

Ref 13

Please

make

cheaper.

Ref 14

Please

discount

more.

Ref 15

Please

bring

the

price

down

more.

Output 0

Please

give

some

discount.

N-grams

Please	give	me	some	discount.
Please	give	me		discount.
Please give
Please give me
	give me

Output 1

please

give

some

N-grams

please	give	me	some	.
please	give	me
	give me

Output 2

Please

give

some

discount.

N-grams

Please	give	me	some	discount.
Please	give	me		discount.
Please give
Please give me
	give me

Output 3

Please

much

some

discountses.

N-grams

Please	much	to	my	some	discountses.
Please

Output 4

Please

give

some

discounts.

N-grams

Please	give	me	some	discounts.
Please	give	me
Please give
Please give me
	give me

Sentence 43) BLEU: 0 (0.7778/0.375/0.1429/0) ; 0 (0.6/0.2222/0/0) ; 0 (0.6667/0.375/0.1429/0) ; 0 (0.7778/0.375/0.1429/0) ; 0.3247 (0.7/0.4444/0.25/0.1429)

Source

��

�Q

�b

��

�p��

�o��

�Y

��\

�C

Ref 0

I'd

have

dinner

here

cabin.

Ref 1

possible

have

dinner

here

cabin?

Ref 2

want

have

dinner

here

cabin.

Ref 3

want

dine

here

cabin.

Ref 4

I'd

eat

dinner

this

cabin.

Ref 5

the

cabin

where

I'd

have

dinner.

Ref 6

Eating

dinner

the

cabin

what

want.

Ref 7

plan

have

dinner

this

cabin.

Ref 8

I'd

prefer

have

dinner

this

cabin.

Ref 9

want

have

dinner

here

the

cabin.

Ref 10

want

have

room

service

for

cabin.

Ref 11

May

have

dinner

cabin?

Ref 12

would

nice

eat

dinner

cabin.

Ref 13

This

evening

would

dine

cabin.

Ref 14

would

dinner

this

cabin.

Ref 15

would

eat

supper

this

cabin.

Output 0

think

cabin

have

dinner

here.

N-grams

I	think	in	my	cabin	to	have	dinner	here.
I		in	my	cabin	to	have	dinner
		in my			to have
					to have dinner
						have dinner

Output 1

think

hut

dinner

here

have

N-grams

i	think	in	my	hut	to	dinner	here	have	.
		in	my		to	dinner	here	have
		in my				dinner here

Output 2

think

hut

eat

dinner

here.

N-grams

I	think	in	my	hut	to	eat	dinner	here.
I		in	my		to	eat	dinner
		in my			to eat
					to eat dinner
						eat dinner

Output 3

think

cabin

have

dinner

here.

N-grams

I	think	in	my	cabin	to	have	dinner	here.
I		in	my	cabin	to	have	dinner
		in my			to have
					to have dinner
						have dinner

Output 4

want

have

the

supper

mine

hut

here.

N-grams

I	want	to	have	the	supper	in	mine	hut	here.
I	want	to	have	the	supper	in
I want		to have			supper in
I want to
I want to have
	want to
	want to have

Sentence 44) BLEU: 0.7071 (0.875/0.7143/0.6667/0.6) ; 0 (0.5/0.2/0/0) ; 0.7071 (0.875/0.7143/0.6667/0.6) ; 0 (0.5556/0.125/0/0) ; 0 (0.2857/0/0/0)

Source

��

�]

��

�b

�X��

��

�F

�C

Ref 0

I've

forgot

bag

the

taxi.

Ref 1

forgot

bag

the

taxi.

Ref 2

I've

forgotten

bag

the

taxi.

Ref 3

left

bag

behind

the

taxi.

Ref 4

forgot

and

left

bag

the

taxi.

Ref 5

forgot

take

bag

out

the

cab.

Ref 6

forgot

bag

when

got

out

the

taxi.

Ref 7

left

bag

the

taxi.

Ref 8

left

bag

behind

the

taxi.

Ref 9

forgot

bag

the

taxi.

Ref 10

left

bag

the

taxi.

Ref 11

bag

still

the

taxi.

Ref 12

The

taxi

left

with

bag

still

inside.

Ref 13

forgot

bag

the

taxi.

Ref 14

have

left

bag

the

taxi.

Ref 15

have

forgotten

bag

the

taxi.

Output 0

forgot

bag

the

taxi

instead.

N-grams

I	forgot	my	bag	in	the	taxi	instead.
I	forgot	my	bag	in	the	taxi
I forgot		my bag		in the
I forgot my			bag in
I forgot my bag
	forgot my		bag in the
	forgot my bag
	forgot my bag in
		my bag in
		my bag in the

Output 1

the

car

N-grams

i	my	in	the	car	.
	my	in	the
		in the

Output 2

forgot

bag

the

taxi

instead.

N-grams

I	forgot	my	bag	in	the	taxi	instead.
I	forgot	my	bag	in	the	taxi
I forgot		my bag		in the
I forgot my			bag in
I forgot my bag
	forgot my		bag in the
	forgot my bag
	forgot my bag in
		my bag in
		my bag in the

Output 3

wrapped

forget

the

for-rent

car.

N-grams

I	my	wrapped	to	forget	in	the	for-rent	car.
I	my		to		in	the
					in the

Output 4

mine

Bao

Wang

rental

car.

N-grams

I	mine	Bao	Wang	in	rental	car.
I				in

Sentence 45) BLEU: 0 (1/0.6667/0.5/0) ; 0 (0.5/0.3333/0/0) ; 0 (1/0.6667/0.5/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�ڭ�

�{�b

�b

��B

�H

Ref 0

Whereabouts

are

now?

Ref 1

Where

are

now?

Ref 2

Where

you

think

are

now?

Ref 3

Could

you

tell

where

are

now?

Ref 4

What

area

this

now?

Ref 5

Where

are

this

point?

Ref 6

What

this

area

we're

in?

Ref 7

Where

are

now?

Ref 8

What's

this

area

now?

Ref 9

Where

would

this

be?

Ref 10

Where

are

now?

Ref 11

What's

our

current

position?

Ref 12

Could

you

tell

where

are

now?

Ref 13

Approximately

where

are

now?

Ref 14

What's

our

present

whereabouts.

Ref 15

What's

our

present

approximate

location.

Output 0

Where

are

now?

N-grams

Where	we	are	now?
Where	we	are	now?
	we are
	we are now?
		are now?

Output 1

where

now

N-grams

where	we	now	?
where	we
where we

Output 2

Where

are

now?

N-grams

Where	we	are	now?
Where	we	are	now?
	we are
	we are now?
		are now?

Output 3

now

where?

N-grams

now

where?

Output 4

now

where?

N-grams

now

where?

Sentence 46) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.3333/0/0/0)

Source

��

�b

�@

�s

�C

�s

�ж�

�C

Ref 0

I'm

room

ten

seventy.

Ref 1

room

ten

seventy.

Ref 2

This

room

ten

seventy.

Ref 3

staying

room

ten

seventy.

Ref 4

room

one-oh-seven-oh.

Ref 5

One-zero-seven-zero

room

number.

Ref 6

That

room

number

one

thousand

seventy.

Ref 7

Room

ten

seventy.

Ref 8

It's

room

ten

seventy.

Ref 9

room

number

ten

seventy.

Ref 10

room

ten

seventy.

Ref 11

room

number

ten

seventy.

Ref 12

I'm

ten

seventy.

Ref 13

For

room

ten

seventy.

Ref 14

room

number

ten

seventy.

Ref 15

staying

room

ten

seventy.

Output 0

1070

rooms.

N-grams

I	am	in	1070	rooms.
I	am	in
I am

Output 1

rooms

N-grams

i	rooms	in	.
		in

Output 2

107

rooms.

N-grams

I	107	0	rooms.
I

Output 3

1070

rooms.

N-grams

I	am	in	1070	rooms.
I	am	in
I am

Output 4

zero

seven

zero

rooms.

N-grams

I	in	zero	seven	zero	rooms.
I	in

Sentence 47) BLEU: 0 (1/0/0/0) ; 0 (0.5/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0) ; 0 (0.6667/0/0/0)

Source

��

�u

�[

�}

�C

Ref 0

Just

sugar,

please.

Ref 1

Can

just

have

sugar,

please?

Ref 2

Could

you

just

give

sugar,

please?

Ref 3

Sugar

only,

please.

Ref 4

Sugar

only,

please.

Ref 5

Please

just

give

some

sugar.

Ref 6

Just

the

sugar,

thanks.

Ref 7

Only

sugar,

please.

Ref 8

I'll

just

have

with

sugar,

please.

Ref 9

Just

sugar

fine.

Ref 10

Sugar

fine.

Ref 11

Could

just

have

some

sugar?

Ref 12

I'll

just

have

some

sugar,

thanks.

Ref 13

Only

sugar,

please.

Ref 14

would

only

sugar,

please.

Ref 15

Sugar

only,

please.

Output 0

Please

only

sugar.

N-grams

Please	only	sugar.
Please	only	sugar.

Output 1

please

only

sugar

N-grams

please	only	sugar	.
	only	sugar

Output 2

Please

only

sugar.

N-grams

Please	only	sugar.
Please	only	sugar.

Output 3

Please

only

sugar.

N-grams

Please	only	sugar.
Please	only	sugar.

Output 4

Please

only

sweeten.

N-grams

Please	only	sweeten.
Please	only

Sentence 48) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.3333/0/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.4/0/0/0) ; 0 (0.6/0.25/0/0)

Source

�o��

��

�@

��

�岫

�C

Ref 0

There

stain

here.

Ref 1

This

stain

here.

Ref 2

Here

stain.

Ref 3

stain

here.

Ref 4

There's

smudge

here.

Ref 5

It's

stained

here.

Ref 6

has

stain

here.

Ref 7

I've

found

stain

here.

Ref 8

There

seems

stain

here.

Ref 9

I've

noticed

blemish

right

here.

Ref 10

It's

stained

here.

Ref 11

found

stain

here.

Ref 12

Here's

stain.

Ref 13

There

stain

this.

Ref 14

This

stain

here.

Ref 15

There

mark

this.

Output 0

There

flaw.

N-grams

There	is	a	flaw.
There	is	a
There is
There is a
	is a

Output 1

here

N-grams

a	here	.
a

Output 2

There

flaw.

N-grams

There	is	a	flaw.
There	is	a
There is
There is a
	is a

Output 3

Here

have

minor

faults.

N-grams

Here	have	a	minor	faults.
Here		a

Output 4

Here

has

slight

defect.

N-grams

Here	has	a	slight	defect.
Here	has	a
	has a

Sentence 49) BLEU: 0 (0.7143/0.3333/0.2/0) ; 0 (0.3333/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.7143/0.3333/0.2/0) ; 0 (0.4/0.25/0/0)

Source

�A

��

�ٳ�

�o��

�å�

�C

Ref 0

You

should

watch

out

for

those

guys.

Ref 1

careful

with

those

people.

Ref 2

Stay

away

from

those

people.

Ref 3

Keep

away

from

those

people.

Ref 4

You

have

careful

with

that

bunch.

Ref 5

You've

got

watch

yourself

around

those

guys.

Ref 6

Watch

yourself

with

that

crowd.

Ref 7

You

careful

those

guys.

Ref 8

Make

sure

that

you

watch

those

guys.

Ref 9

Use

caution

with

those

guys.

Ref 10

You're

better

careful

those

guys.

Ref 11

Keep

eye

those

guys.

Ref 12

Please

look

out

for

those

guys.

Ref 13

You

should

careful

those

people.

Ref 14

Beware

those

guys.

Ref 15

careful

those

people.

Output 0

You

should

guard

these

guys.

N-grams

You	should	be	on	guard	these	guys.
You	should	be	on			guys.
You should
You should be
	should be

Output 1

you

should

alert

these

guys

N-grams

you	should	alert	these	guys	.
you	should

Output 2

You

should

alert

these

guys.

N-grams

You	should	alert	these	guys.
You	should			guys.
You should

Output 3

You

should

guard

these

guys.

N-grams

You	should	be	on	guard	these	guys.
You	should	be	on			guys.
You should
You should be
	should be

Output 4

You

should

alert

these

fellows.

N-grams

You	should	alert	these	fellows.
You	should
You should

Sentence 50) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.5/0.2/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.8/0.5/0.3333/0)

Source

��

�Q

�n

�@

��

�y��

�C

Ref 0

I'd

middle

seat.

Ref 1

May

have

middle

seat?

Ref 2

Could

you

give

middle

seat?

Ref 3

Please

seat

the

middle.

Ref 4

seat

the

middle

would

good.

Ref 5

the

mid-section

would

nice.

Ref 6

I'm

hoping

get

seat

the

middle.

Ref 7

I'd

seat

the

middle.

Ref 8

Could

have

center

seat?

Ref 9

was

hoping

for

middle

seat?

Ref 10

Could

have

middle

seat?

Ref 11

middle

seat,

please.

Ref 12

Get

middle

seat.

Ref 13

would

sit

the

middle.

Ref 14

would

prefer

seat

the

center.

Ref 15

seat

the

center

would

good.

Output 0

want

middle

seat.

N-grams

I	want	a	middle	seat.
I		a	middle	seat.
		a middle
		a middle seat.
			middle seat.

Output 1

want

middle

seat

N-grams

i	want	a	middle	seat	.
		a	middle	seat
		a middle

Output 2

want

middle

seat.

N-grams

I	want	a	middle	seat.
I		a	middle	seat.
		a middle
		a middle seat.
			middle seat.

Output 3

want

seat

middle.

N-grams

I	want	a	seat	of	middle.
I		a	seat		middle.
		a seat

Output 4

want

middle

seat.

N-grams

I	want	a	middle	seat.
I		a	middle	seat.
		a middle
		a middle seat.
			middle seat.

Sentence 51) BLEU: 0 (0.4286/0/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.7143/0.3333/0/0) ; 0 (0.5714/0.1667/0/0) ; 0 (0.6667/0.4/0.25/0)

Source

��

�O

��

�ݣC��@��

�޲z

��

�H

Ref 0

conducted

Seiji

Ozawa?

Ref 1

Does

Seiji

Ozawa

conduct

it?

Ref 2

the

conductor

Seiji

Ozawa?

Ref 3

Seiji

Ozawa

who

conducting

it?

Ref 4

the

conductor

Seiji

Ozawa?

Ref 5

Will

Seiji

Ozawa

conducting?

Ref 6

Will

Seiji

Ozawa

the

conductor?

Ref 7

the

conductor

Seiji

Ozawa?

Ref 8

Seiji

Ozawa

the

conductor?

Ref 9

Will

the

conductor

Seiji

Ozawa?

Ref 10

Seiji

Ozawa

the

conductor?

Ref 11

Will

Seiji

Ozawa

conduct?

Ref 12

Seiji

Ozawa

conducting?

Ref 13

Seiji

Ozawa

conducting?

Ref 14

Will

Seiji

Ozawa

conducting?

Ref 15

Seiji

Ozawa

the

conductor?

Output 0

managed

seiji

ozawa

it?

N-grams

It	is	managed	by	seiji	ozawa	it?
	is		by			it?

Output 1

managed

seiji

ozawa

N-grams

it	is	managed	by	seiji	ozawa	?
it	is		by

Output 2

managed

Seiji

Ozawa

it?

N-grams

It	is	managed	by	Seiji	Ozawa	it?
	is		by	Seiji	Ozawa	it?
			by Seiji
				Seiji Ozawa

Output 3

managed

the

��ݣC��@��

N-grams

Is	it	managed	by	the	��ݣC��@��	?
Is	it		by	the
Is it

Output 4

manages

Seiji

Ozawa?

N-grams

It	is	manages	by	Seiji	Ozawa?
	is		by	Seiji	Ozawa?
			by Seiji
			by Seiji Ozawa?
				Seiji Ozawa?

Sentence 52) BLEU: 0 (0.625/0.5714/0.1667/0) ; 0 (0.5714/0.1667/0/0) ; 0 (0.8333/0.6/0/0) ; 0 (0.625/0.5714/0.1667/0) ; 0.317 (0.8333/0.3636/0.3/0.1111)

Source

�S��

�B��

��

�R

�o��

��

�H

Ref 0

Can

buy

this

without

prescription?

Ref 1

Could

you

sell

this

without

prescription?

Ref 2

buy

this

without

prescription?

Ref 3

May

purchase

this

without

prescription?

Ref 4

Can

get

this

even

without

prescription?

Ref 5

don't

have

prescription,

can

still

buy

it?

Ref 6

Can

get

over

the

counter?

Ref 7

possible

buy

this

without

prescription?

Ref 8

Can

this

purchased

without

prescription?

Ref 9

Would

able

buy

this

without

prescription?

Ref 10

possible

get

this

without

prescription?

Ref 11

need

prescription

for

this?

Ref 12

prescription

required

buy

this?

Ref 13

available

without

prescription?

Ref 14

May

purchase

this

non-prescription

medication?

Ref 15

Can

buy

over-the-counter?

Output 0

There

prescription,

can

buy

this?

N-grams

There	is	no	prescription,	can	I	buy	this?
			prescription,	can	I	buy	this?
			prescription, can		I buy
			prescription, can I			buy this?
				can I

Output 1

prescription

can

buy

this

N-grams

no	prescription	can	i	buy	this	?
	prescription	can		buy	this
				buy this

Output 2

prescription

can

buy

this?

N-grams

No	prescription	can	I	buy	this?
	prescription	can	I	buy	this?
		can I		buy this?
			I buy

Output 3

There

prescription,

can

buy

this?

N-grams

There	is	no	prescription,	can	I	buy	this?
			prescription,	can	I	buy	this?
			prescription, can		I buy
			prescription, can I			buy this?
				can I

Output 4

Does

not

have

the

prescription

able

buy

this?

N-grams

Does	not	have	the	prescription	I	to	be	able	to	buy	this?
		have	the	prescription	I	to	be	able	to buy		this?
							be able		to buy this?
							be able to			buy
							be able to buy
								able to		buy this?
								able to buy

Sentence 53) BLEU: 1 (1/1/1/1) ; 0 (0.8/0.5/0/0) ; 0 (1/0.5/0/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1)

Source

�A

��

�F

��

�H

Ref 0

What

did

you

say?

Ref 1

beg

your

pardon.

Ref 2

What

was

you

said?

Ref 3

I'm

afraid

couldn't

catch

that.

Ref 4

What

was

you

said?

Ref 5

What

was

that?

Ref 6

didn't

catch

what

you

said.

Ref 7

Pardon

me?

Ref 8

Sorry,

didn't

catch

that.

Ref 9

What

was

you

said?

Ref 10

Could

you

repeat

that?

Ref 11

Can

you

say

that

again?

Ref 12

Say

that

again,

please.

Ref 13

What

that

you

said?

Ref 14

May

ask

what

you

said?

Ref 15

What

were

you

saying?

Output 0

What

did

you

say?

N-grams

What	did	you	say?
What	did	you	say?
What did		you say?
What did you
What did you say?
	did you
	did you say?

Output 1

what

you

say

did

N-grams

what	you	say	did	?
what	you	say	did
what you
	you say

Output 2

What

you

say?

N-grams

What	you	say?
What	you	say?
	you say?

Output 3

What

did

you

say?

N-grams

What	did	you	say?
What	did	you	say?
What did		you say?
What did you
What did you say?
	did you
	did you say?

Output 4

What

did

you

say?

N-grams

What	did	you	say?
What	did	you	say?
What did		you say?
What did you
What did you say?
	did you
	did you say?

Sentence 54) BLEU: 0 (1/0.75/0.3333/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (1/0.75/0.3333/0) ; 0 (1/0.75/0.3333/0)

Source

��

�b

��X

�@

��

�B��

�C

Ref 0

I'm

visiting

friend.

Ref 1

I'm

seeing

friend.

Ref 2

I've

come

here

visit

friend.

Ref 3

I'm

going

meet

friend.

Ref 4

I'm

here

see

friend.

Ref 5

came

visit

friend.

Ref 6

The

reason

I'm

here

visit

friend.

Ref 7

came

visit

friend.

Ref 8

I'm

here

visit

with

friend.

Ref 9

I've

come

visit

friend.

Ref 10

I'm

coming

see

friend.

Ref 11

I've

come

visit

friend.

Ref 12

have

friend

want

visit.

Ref 13

going

visit

friend.

Ref 14

going

see

friend.

Ref 15

meeting

friend.

Output 0

visiting

friend.

N-grams

I	am	visiting	a	friend.
I	am	visiting	a	friend.
I am		visiting a
		visiting a friend.
			a friend.

Output 1

friend

visiting

N-grams

i	a	friend	am	visiting	.
	a	friend	am	visiting
	a friend

Output 2

visited

friend.

N-grams

I	visited	a	friend.
I		a	friend.
		a friend.

Output 3

visiting

friend.

N-grams

I	am	visiting	a	friend.
I	am	visiting	a	friend.
I am		visiting a
		visiting a friend.
			a friend.

Output 4

visiting

friend.

N-grams

I	am	visiting	a	friend.
I	am	visiting	a	friend.
I am		visiting a
		visiting a friend.
			a friend.

Sentence 55) BLEU: 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.25/0/0/0)

Source

��

�o��

��

�H

Ref 0

Can

try

out?

Ref 1

May

try

on?

Ref 2

try

on?

Ref 3

Would

possible

try

on?

Ref 4

Can

give

try?

Ref 5

try

it?

Ref 6

May

try

and

see?

Ref 7

okay

try?

Ref 8

May

try?

Ref 9

Can

give

shot?

Ref 10

you

mind

try

it?

Ref 11

May

try

out?

Ref 12

I'd

try

out.

Ref 13

May

try

it?

Ref 14

May

test

out?

Ref 15

May

give

try?

Output 0

can

test

this?

N-grams

I	can	test	this?
I		test

Output 1

can

this

experiment

N-grams

can

this

experiment

Output 2

can

test

this?

N-grams

I	can	test	this?
I		test

Output 3

Can

experiment

this?

N-grams

Can	I	experiment	this?
Can	I
Can I

Output 4

can

experiment

this?

N-grams

I	can	experiment	this?
I

Sentence 56) BLEU: 0.3549 (0.8/0.5556/0.25/0.1429) ; 0 (0.6667/0.25/0/0) ; 0 (0.5833/0.09091/0/0) ; 0.3549 (0.8/0.5556/0.25/0.1429) ; 0.4671 (0.8/0.5556/0.375/0.2857)

Source

�

�C

��

�Q

�A

��

�F

�C

Ref 0

No.

I'm

afraid

you

took

the

wrong

train.

Ref 1

No.

Are

you

sure

you

took

the

right

train?

Ref 2

No.

Didn't

you

take

the

wrong

train?

Ref 3

No.

Isn't

that

you

got

the

wrong

train?

Ref 4

No.

Didn't

you

take

the

wrong

train?

Ref 5

No.

Couldn't

you

have

made

mistake

the

train

you

took?

Ref 6

No.

Could

you

have

taken

the

wrong

train?

Ref 7

don't

think

so.

seems

you've

taken

the

wrong

train.

Ref 8

I'm

afraid

not.

You've

probably

taken

the

wrong

train.

Ref 9

No,

isn't.

think

you

might

have

taken

the

wrong

train.

Ref 10

Not

all.

think

you've

got

the

wrong

train.

Ref 11

It's

not.

You

may

have

got

the

wrong

train.

Ref 12

No,

it's

not.

You

must

have

the

wrong

train.

Ref 13

No.

think

you

rode

the

wrong

train.

Ref 14

No.

Perhaps,

you

got

the

wrong

train.

Ref 15

No.

You

may

have

ridden

the

wrong

train.

Output 0

Not.

think

that

you

perhaps

took

the

wrong

train.

N-grams

Not.	I	think	that	you	perhaps	took	the	wrong	train.
	I	think	that	you		took	the	wrong	train.
	I think		that you			took the		wrong train.
						took the wrong
						took the wrong train.
							the wrong
							the wrong train.

Output 1

think

you

train

that

perhaps

the

wrong

N-grams

i	think	you	train	that	perhaps	the	wrong	.
	think	you	train	that		the	wrong
	think you					the wrong

Output 2

不.

think

afraid

sit

you

train

mistake.

N-grams

不.	I	think	I	am	afraid	to	sit	you	train	a	mistake.
	I	think			afraid			you	train	a
	I think

Output 3

Not.

think

that

you

perhaps

took

the

wrong

train.

N-grams

Not.	I	think	that	you	perhaps	took	the	wrong	train.
	I	think	that	you		took	the	wrong	train.
	I think		that you			took the		wrong train.
						took the wrong
						took the wrong train.
							the wrong
							the wrong train.

Output 4

No.

thought

that

perhaps

you

rode

the

wrong

train.

N-grams

No.	I	thought	that	perhaps	you	rode	the	wrong	train.
No.	I		that		you	rode	the	wrong	train.
No. I					you rode		the wrong
					you rode the			wrong train.
					you rode the wrong
						rode the
						rode the wrong
						rode the wrong train.
							the wrong train.

Sentence 57) BLEU: 0 (0/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0/0/0/0)

Source

�o

�O

�ܽK

��

�H

Ref 0

wrinkle-free?

Ref 1

Will

wrinkle?

Ref 2

Will

this

wrinkle?

Ref 3

Will

this

get

wrinkly?

Ref 4

permanent

press?

Ref 5

non-wrinkle?

Ref 6

wrinkle-resistant?

Ref 7

Won't

this

wrinkle?

Ref 8

this

wrinkle-resistant?

Ref 9

this

going

wrinkle-resistant?

Ref 10

Will

get

easily

creased?

Ref 11

Will

crease?

Ref 12

Does

get

wrinkled?

Ref 13

free

wrinkles?

Ref 14

Does

stay

smooth

from

wrinkles?

Ref 15

Does

stay

free

wrinkles?

Output 0

This

the

anti-wrinkle?

N-grams

This

the

anti-wrinkle?

Output 1

this

the

anti-wrinkle

N-grams

this	is	the	anti-wrinkle	?
this

Output 2

This

the

right

anti-wrinkle?

N-grams

This

the

right

anti-wrinkle?

Output 3

this

the

anti-wrinkle?

N-grams

Is	this	the	anti-wrinkle?
Is	this
Is this

Output 4

This

the

anti-wrinkle?

N-grams

This

the

anti-wrinkle?

Sentence 58) BLEU: 0 (0.5714/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.5714/0/0/0) ; 0.3303 (0.6667/0.375/0.2857/0.1667) ; 0 (0/0/0/0)

Source

��

�ܦh

��

�a��

�b

��

�H

Ref 0

Where

spot

where

there

are

lot

fish?

Ref 1

What

place

has

lot

fish?

Ref 2

Where

there

place

where

lot

fish

can

found?

Ref 3

Where

the

fish

school?

Ref 4

Where

place

with

lots

fish?

Ref 5

Where's

spot

that

the

fish

come

to?

Ref 6

Where's

the

location

with

bunch

fish?

Ref 7

you

know

any

spots

where

there

are

lots

fish?

Ref 8

What

are

some

spots

that

have

lots

fish?

Ref 9

Which

spots

have

abundance

fish?

Ref 10

Where

most

the

fish

tend

be?

Ref 11

Whereabouts

can

find

lot

fish?

Ref 12

Where

can

you

find

large

concentration

fish?

Ref 13

Where

there

area

with

lot

fish?

Ref 14

Where

may

there

place

that

has

lots

fish?

Ref 15

Where

can

find

spot

that

has

lots

fish?

Output 0

There

are

many

places

where

the

fish?

N-grams

There	are	many	places	where	the	fish?
	are			where	the	fish?

Output 1

are

many

places

fish

N-grams

are	many	places	fish	?
are			fish

Output 2

There

are

many

places

where

the

fish?

N-grams

There	are	many	places	where	the	fish?
	are			where	the	fish?

Output 3

Which

are

lot

places

fishes

N-grams

Which	are	a	lot	of	places	of	fishes	?
Which	are	a	lot	of		of
	are a		lot of
	are a lot
	are a lot of
		a lot
		a lot of

Output 4

Has

many

fish's

places

in?

N-grams

Has

many

fish's

places

in?

Sentence 59) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.5/0.2/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.8/0.5/0.3333/0)

Source

��

�Q

��

�@�U

�o��

�C

Ref 0

I'd

try

these

on.

Ref 1

May

try

these

on?

Ref 2

try

these

on?

Ref 3

Would

possible

try

these

on?

Ref 4

I'd

try

these

for

size.

Ref 5

I'm

hoping

try

these

and

see

how

they

fit.

Ref 6

want

try

the

fit

these.

Ref 7

Could

try

these

on?

Ref 8

want

try

these

on.

Ref 9

possible

try

these

on?

Ref 10

Can

try

them

on?

Ref 11

want

try

them

on.

Ref 12

you

mind

trying

them

on?

Ref 13

would

put

these

on.

Ref 14

would

try

them

on.

Ref 15

would

give

them

try.

Output 0

want

test

these.

N-grams

I	want	to	test	these.
I	want	to		these.
I want
I want to
	want to

Output 1

want

these

experiment

N-grams

i	want	to	these	experiment	.
	want	to	these
	want to

Output 2

want

test

these.

N-grams

I	want	to	test	these.
I	want	to		these.
I want
I want to
	want to

Output 3

want

experiment

these.

N-grams

I	want	to	experiment	these.
I	want	to		these.
I want
I want to
	want to

Output 4

want

experiment

these.

N-grams

I	want	to	experiment	these.
I	want	to		these.
I want
I want to
	want to

Sentence 60) BLEU: 0 (0.4/0.25/0/0) ; 0 (0/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.25/0.1429/0/0) ; 0 (0.1818/0/0/0)

Source

�S��D

�C

��

�O��

��

�H

Ref 0

All

right.

Anything

else?

Ref 1

Fine.

Would

you

order

anything

else?

Ref 2

Alright.

Would

you

anything

else?

Ref 3

OK.

there

anything

else

can

get

you?

Ref 4

OK.

that

it?

Ref 5

Sure.

you

need

anything

else?

Ref 6

Yes.

Can

get

anything

else

for

you?

Ref 7

Sure.

Will

there

anything

else?

Ref 8

Okay.

Will

that

all?

Ref 9

Got

it.

Would

you

anything

else?

Ref 10

Fine.

Would

you

anything

else?

Ref 11

Got

it.

there

anything

else

you

would

like?

Ref 12

Okay.

May

bring

you

anything

else?

Ref 13

Yes.

there

anything

else

for

you?

Ref 14

Yes.

Will

this

all?

Ref 15

Yes.

Will

there

anything

else?

Output 0

problem.

There

anything

else?

N-grams

No	problem.	There	anything	else?
			anything	else?
			anything else?

Output 1

what

N-grams

what

Output 2

problem.

There

anything

else?

N-grams

No	problem.	There	anything	else?
			anything	else?
			anything else?

Output 3

All

right.

Still

different

from

what?

N-grams

All	right.	Still	is	different	from	of	what?
All	right.
All right.

Output 4

Does

not

have

the

question.

also

able

discriminate

what?

N-grams

Does	not	have	the	question.	Is	also	able	to	discriminate	what?
					Is			to

Sentence 61) BLEU: 0.2907 (0.6/0.3333/0.25/0.1429) ; 0 (0.5556/0.125/0/0) ; 0.2907 (0.6/0.3333/0.25/0.1429) ; 0 (0.8/0.4444/0/0) ; 0 (0.8333/0.2/0/0)

Source

��

�y��

��^

��B

��

�H

Ref 0

May

put

seat

back?

Ref 1

Would

you

mind

recline

seat?

Ref 2

recline?

Ref 3

you

care

recline

seat?

Ref 4

put

seat

down?

Ref 5

Will

all

right

put

back

seat?

Ref 6

Can

lower

seat

back?

Ref 7

okay

put

seat

back?

Ref 8

Could

put

seat

down?

Ref 9

alright

for

seat

pushed

back?

Ref 10

okay

put

seat

back?

Ref 11

Can

tip

seat

back?

Ref 12

you

mind

tip

back

seat?

Ref 13

May

recline

seat

back?

Ref 14

alright

lower

seat

back?

Ref 15

alright

recline

the

seat

back?

Output 0

recline

seat

back

into

the

original

position

it?

N-grams

I	recline	my	seat	back	into	the	original	position	it?
I	recline	my	seat	back		the
I recline		my seat
I recline my
I recline my seat
	recline my
	recline my seat

Output 1

seat

back

the

original

can

put

N-grams

i	my	seat	back	the	original	can	put	?
	my	seat	back	the			put
	my seat

Output 2

recline

seat

back

into

the

original

position

it?

N-grams

I	recline	my	seat	back	into	the	original	position	it?
I	recline	my	seat	back		the
I recline		my seat
I recline my
I recline my seat
	recline my
	recline my seat

Output 3

Can

put

back

the

original

place

seat?

N-grams

Can	I	put	back	the	original	place	to	my	seat?
Can	I	put	back	the			to	my	seat?
Can I		put back						my seat?
	I put

Output 4

can

seat

put

back?

N-grams

I	can	my	seat	put	back?
I		my	seat	put	back?
		my seat

Sentence 62) BLEU: 0 (0.5714/0.1667/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.5714/0.1667/0/0) ; 0 (0.625/0.4286/0.1667/0) ; 0 (0.5556/0.125/0/0)

Source

��

�A

��

�M

��

�H

Ref 0

Shall

bring

you

drink?

Ref 1

Shall

get

you

drink?

Ref 2

you

want

bring

you

drink?

Ref 3

Would

you

get

you

drink?

Ref 4

Can

bring

you

something

drink?

Ref 5

Could

get

you

drink?

Ref 6

Would

you

get

drink

for

you?

Ref 7

Would

you

bring

you

drink?

Ref 8

Could

get

you

drink?

Ref 9

May

bring

you

drink?

Ref 10

Would

you

bring

you

drink?

Ref 11

Can

get

you

drink?

Ref 12

you

care

for

drink?

Ref 13

May

bring

you

drink?

Ref 14

Can

get

you

drink?

Ref 15

Can

bring

you

anything

drink?

Output 0

can

give

you

cup

drink?

N-grams

I	can	give	you	a	cup	drink?
I			you	a		drink?
			you a

Output 1

can

you

cup

drink

take

N-grams

i	can	you	cup	drink	take	?
		you		drink

Output 2

can

give

you

cup

drink?

N-grams

I	can	give	you	a	cup	drink?
I			you	a		drink?
			you a

Output 3

Can

take

what

cup

drink

for

you?

N-grams

Can	I	take	what	cup	drink	for	you?
Can	I				drink	for	you?
Can I					drink for
					drink for you?
						for you?

Output 4

can

take

the

cup

you

drink?

N-grams

I	can	take	the	cup	to	you	to	drink?
I					to	you	to drink?
								drink?

Sentence 63) BLEU: 1 (1/1/1/1) ; 0 (0.6/0.25/0/0) ; 1 (1/1/1/1) ; 0 (0.5/0.4/0.25/0) ; 0 (0/0/0/0)

Source

��

�ɶ�

�}�l

��~

�H

Ref 0

What

time

does

open?

Ref 1

What

time

they

open?

Ref 2

What

the

opening

time?

Ref 3

What

are

the

business

hours?

Ref 4

What

time

the

doors

open?

Ref 5

What

time

open?

Ref 6

What

time

they

open

up?

Ref 7

When

does

open?

Ref 8

When

will

open?

Ref 9

what

time

does

open?

Ref 10

What's

the

opening

time?

Ref 11

When

does

open?

Ref 12

what

time

will

open?

Ref 13

When

does

open?

Ref 14

When

will

open?

Ref 15

When

open?

Output 0

What

time

does

open?

N-grams

What	time	does	it	open?
What	time	does	it	open?
What time		does it
What time does			it open?
What time does it
	time does
	time does it
	time does it open?
		does it open?

Output 1

does

when

business

N-grams

does	it	when	business	?
does	it		business
does it

Output 2

What

time

does

open?

N-grams

What	time	does	it	open?
What	time	does	it	open?
What time		does it
What time does			it open?
What time does it
	time does
	time does it
	time does it open?
		does it open?

Output 3

When

does

start

doing

business?

N-grams

When	does	it	start	doing	business?
When	does	it
When does
When does it
	does it

Output 4

Its

when

commencement

business?

N-grams

Its

when

commencement

business?

Sentence 64) BLEU: 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0)

Source

�[

��o

��

�H

Ref 0

With

cream?

Ref 1

Would

you

cream?

Ref 2

you

want

cream?

Ref 3

Want

cream?

Ref 4

you

want

cream

it?

Ref 5

you

take

cream?

Ref 6

you

want

cream

that?

Ref 7

Would

you

cream?

Ref 8

Will

you

have

cream

with

that?

Ref 9

Should

add

cream?

Ref 10

Would

you

some

cream

added?

Ref 11

Would

you

add

some

cream?

Ref 12

What

about

some

cream?

Ref 13

Would

you

cream

that?

Ref 14

Would

you

with

cream?

Ref 15

you

want

cream

it?

Output 0

Adds

the

cream?

N-grams

Adds	the	cream?
		cream?

Output 1

add

butter

N-grams

add	butter	?
add

Output 2

Add

butter

it?

N-grams

Add	butter	it?
		it?

Output 3

Add

butter?

N-grams

Add

butter?

Output 4

Adds

the

cream?

N-grams

Adds	the	cream?
		cream?

Sentence 65) BLEU: 0 (0.2222/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.2222/0/0/0) ; 0 (0.7/0.3333/0.125/0) ; 0 (0.4167/0.09091/0/0)

Source

�A��

��~

�q

�X�I

��

�X�I

�H

Ref 0

From

what

time

what

time

are

you

open?

Ref 1

What

are

the

hours

you

are

open?

Ref 2

What

are

your

business

hours?

Ref 3

From

what

time

what

time

you

open?

Ref 4

What

are

your

hours

operation?

Ref 5

What

time

you

open

and

close?

Ref 6

What

are

your

opening

and

closing

times?

Ref 7

From

when

are

your

hours

operation?

Ref 8

From

what

time

until

what

time

are

your

hours

operation?

Ref 9

What

time

what

time

would

your

hours

be?

Ref 10

What

are

your

business

hours?

Ref 11

When

are

your

opening

hours?

Ref 12

From

when

you

open?

Ref 13

From

what

time

you

open

and

what

time

you

at?

Ref 14

What

are

your

hours

business?

Ref 15

What

time

you

open

and

close.

Output 0

Your

business

from

few

points?

N-grams

Your	business	from	a	few	to	a	few	points?
	business				to

Output 1

business

from

you

N-grams

business	from	to	you	do	?
business		to	you	do

Output 2

Your

business

from

few

points?

N-grams

Your	business	from	a	few	to	a	few	points?
	business				to

Output 3

You

business

what

time

what

time

from?

N-grams

You	do	business	what	time	go	to	what	time	from?
	do	business	what	time		to	what	time
			what time			to what
						to what time
							what time

Output 4

How

many

spots

you

business

from

how

many

spots?

N-grams

How	many	spots	do	you	do	business	from	to	how	many	spots?
			do	you	do	business		to
			do you

Sentence 66) BLEU: 1 (1/1/1/1) ; 0.4347 (0.625/0.5714/0.5/0.2) ; 0.5411 (0.75/0.5714/0.5/0.4) ; 1 (1/1/1/1) ; 0.5411 (0.75/0.5714/0.5/0.4)

Source

��

��D

�p��

�P��

�A

�C

Ref 0

don't

know

how

thank

you.

Ref 1

can't

thank

you

enough.

Ref 2

have

idea

how

thank

you.

Ref 3

Words

can't

express

how

thankful

am.

Ref 4

Words

can't

express

appreciation.

Ref 5

have

words

thank

you.

Ref 6

can't

thank

you

enough.

Ref 7

can't

thank

you

enough.

Ref 8

have

words

express

gratitude.

Ref 9

There

are

words

express

thanks.

Ref 10

can't

say

how

grateful

am.

Ref 11

have

words

thank

you.

Ref 12

can't

say

enough

how

much

appreciate

it.

Ref 13

can't

thank

you

enough.

Ref 14

grateful

beyond

words.

Ref 15

don't

know

there

any

way

thank

you

enough.

Output 0

don't

know

how

thank

you.

N-grams

I	don't	know	how	to	thank	you.
I	don't	know	how	to	thank	you.
I don't		know how		to thank
I don't know			how to		thank you.
I don't know how				to thank you.
	don't know		how to thank
	don't know how
	don't know how to
		know how to
		know how to thank
			how to thank you.

Output 1

not

know

how

thank

you

N-grams

i	not	know	how	to	thank	you	.
		know	how	to	thank	you
		know how		to thank
		know how to			thank you
		know how to thank
			how to
			how to thank
				to thank you

Output 2

not

know

how

thank

you.

N-grams

I	do	not	know	how	to	thank	you.
I			know	how	to	thank	you.
			know how		to thank
			know how to			thank you.
			know how to thank
				how to
				how to thank
				how to thank you.
					to thank you.

Output 3

don't

know

how

thank

you.

N-grams

I	don't	know	how	to	thank	you.
I	don't	know	how	to	thank	you.
I don't		know how		to thank
I don't know			how to		thank you.
I don't know how				to thank you.
	don't know		how to thank
	don't know how
	don't know how to
		know how to
		know how to thank
			how to thank you.

Output 4

did

not

know

how

thank

you.

N-grams

I	did	not	know	how	to	thank	you.
I			know	how	to	thank	you.
			know how		to thank
			know how to			thank you.
			know how to thank
				how to
				how to thank
				how to thank you.
					to thank you.

Sentence 67) BLEU: 1 (1/1/1/1) ; 0 (0.6/0.25/0/0) ; 1 (1/1/1/1) ; 0 (0.3333/0/0/0) ; 0.7071 (1/0.75/0.6667/0.5)

Source

��

��E

�F

�C

Ref 0

I've

got

stiff

neck.

Ref 1

neck

stiff.

Ref 2

have

stiff

neck.

Ref 3

neck

feels

stiff.

Ref 4

neck

tight.

Ref 5

I'm

having

neck

pains.

Ref 6

feel

twisted

neck.

Ref 7

neck

stiff.

Ref 8

have

sore

neck.

Ref 9

I'm

suffering

from

stiffness

neck.

Ref 10

have

stiff

neck.

Ref 11

neck

stiff.

Ref 12

can't

move

neck.

Ref 13

neck

sore.

Ref 14

neck

stiff.

Ref 15

difficult

move

neck.

Output 0

have

stiff

neck.

N-grams

I	have	a	stiff	neck.
I	have	a	stiff	neck.
I have		a stiff
I have a			stiff neck.
I have a stiff
	have a
	have a stiff
	have a stiff neck.
		a stiff neck.

Output 1

stiff

neck

N-grams

i	a	stiff	neck	.
	a	stiff	neck
	a stiff

Output 2

have

stiff

neck.

N-grams

I	have	a	stiff	neck.
I	have	a	stiff	neck.
I have		a stiff
I have a			stiff neck.
I have a stiff
	have a
	have a stiff
	have a stiff neck.
		a stiff neck.

Output 3

fell

Zhen.

N-grams

I	fell	Zhen.
I

Output 4

got

stiff

neck.

N-grams

I	got	a	stiff	neck.
I	got	a	stiff	neck.
	got a		stiff neck.
	got a stiff
	got a stiff neck.
		a stiff
		a stiff neck.

Sentence 68) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.4/0/0/0) ; 0 (0.75/0.3333/0/0) ; 1 (1/1/1/1) ; 0 (0.6/0/0/0)

Source

��

�b

��

�Q

��

�H

Ref 0

Where

was

stolen?

Ref 1

Where

did

you

have

stolen?

Ref 2

Where

were

you

robbed?

Ref 3

Where

did

you

get

stolen?

Ref 4

Where

was

when

was

stolen?

Ref 5

Where

was

when

was

taken?

Ref 6

Where

did

the

theft

happen?

Ref 7

Where

did

get

stolen?

Ref 8

Whereabouts

was

taken?

Ref 9

what

area

did

get

stolen?

Ref 10

Where

did

you

have

taken?

Ref 11

Where

did

the

theft

occur?

Ref 12

Where

were

you

when

was

pinched?

Ref 13

Where

was

taken

from?

Ref 14

Where

did

get

stolen

from?

Ref 15

Where

did

the

thieves

steal

from?

Output 0

Where

stolen?

N-grams

Where	is	it	stolen?
Where		it	stolen?
		it stolen?

Output 1

where

stolen

N-grams

where	is	it	stolen	?
		it	stolen

Output 2

Where

stolen?

N-grams

Where	is	it	stolen?
Where		it	stolen?
		it stolen?

Output 3

Where

was

stolen?

N-grams

Where	was	it	stolen?
Where	was	it	stolen?
Where was		it stolen?
Where was it
Where was it stolen?
	was it
	was it stolen?

Output 4

Where

stolen?

N-grams

Where	is	it	in	stolen?
Where		it		stolen?

Sentence 69) BLEU: 0 (0.875/0.5714/0.3333/0) ; 0 (0.4/0/0/0) ; 0 (0.875/0.5714/0.3333/0) ; 0 (0.2727/0/0/0) ; 0 (0.6/0/0/0)

Source

��Z

�@�U

�A

��

�i

��

�H

Ref 0

Excuse

me,

can

you

take

picture?

Ref 1

Excuse

me,

would

you

mind

taking

picture?

Ref 2

Excuse

me,

but

could

you

take

photo?

Ref 3

Excuse

me,

would

you

please

take

picture?

Ref 4

Sorry,

could

you

take

picture

for

me?

Ref 5

Pardon

me,

could

you

snap

picture

for

me?

Ref 6

Excuse

me,

would

you

mind

taking

picture

for

me?

Ref 7

Sorry,

but

would

you

mind

taking

picture?

Ref 8

Excuse

me,

could

bother

you

take

picture?

Ref 9

Pardon

me,

could

you

take

picture?

Ref 10

Sorry,

would

you

mind

taking

picture?

Ref 11

Sorry

disturb

you

but

could

you

take

picture?

Ref 12

Sorry

bother

you

but

please

could

you

take

picture

me?

Ref 13

Excuse

me,

may

ask

you

take

picture?

Ref 14

Excuse

me,

would

you

mind

taking

picture

for

me?

Ref 15

Excuse

me,

could

you

take

picture

for

me?

Output 0

Excuse

me,

can

take

picture

it?

N-grams

Excuse	me,	can	I	take	a	picture	it?
Excuse	me,	can	I	take	a	picture
Excuse me,				take a
Excuse me, can				take a picture
	me, can				a picture

Output 1

can

N-grams

me	,	can	a	?
		can	a

Output 2

Excuse

me,

can

take

picture

it?

N-grams

Excuse	me,	can	I	take	a	picture	it?
Excuse	me,	can	I	take	a	picture
Excuse me,				take a
Excuse me, can				take a picture
	me, can				a picture

Output 3

Bother

while,

can

give

shine

piece

mutually?

N-grams

Bother	a	while,	can	give	me	shine	on	a	piece	mutually?
	a		can

Output 4

Disturbs,

can

photograph

me?

N-grams

Disturbs,	can	photograph	to	me?
	can		to	me?

Sentence 70) BLEU: 0.502 (0.8889/0.5/0.4286/0.3333) ; 0.5411 (0.75/0.5714/0.5/0.4) ; 0.6389 (0.7/0.6667/0.625/0.5714) ; 0 (0.5714/0.1667/0/0) ; 0.502 (0.8889/0.5/0.4286/0.3333)

Source

��

�ݬ�

��

��u

�m

�C

Ref 0

Please

show

that

sweater.

Ref 1

Can

have

look

that

sweater?

Ref 2

Could

you

show

that

sweater?

Ref 3

May

take

look

that

sweater?

Ref 4

Please

let

see

that

sweater.

Ref 5

Please

let

have

look

that

sweater.

Ref 6

Please

give

look

that

sweater.

Ref 7

I'd

see

that

sweater,

please.

Ref 8

Could

you

show

that

sweater,

please?

Ref 9

May

see

that

sweater,

please?

Ref 10

May

have

look

that

sweater?

Ref 11

Could

you

show

that

sweater?

Ref 12

would

have

look

the

sweater

over

there?

Ref 13

would

see

that

sweater,

please.

Ref 14

Please

let

see

that

sweater,

please.

Ref 15

would

closer

look

that

sweater,

please.

Output 0

Please

have

look

that

sweater

me.

N-grams

Please	have	a	look	at	that	sweater	to	me.
Please	have	a	look	at	that	sweater	to
	have a		look at
	have a look			at that
	have a look at
		a look
		a look at
		a look at that
			look at that

Output 1

please

look

that

sweater

N-grams

please	me	a	look	at	that	sweater	.
	me	a	look	at	that	sweater
	me a		look at
	me a look			at that
	me a look at
		a look
		a look at
		a look at that
			look at that

Output 2

Please

give

look

the

pieces

sweaters.

N-grams

Please	give	me	a	look	at	the	pieces	of	sweaters.
Please	give	me	a	look	at	the
Please give		me a		look at
Please give me			a look		at the
Please give me a				look at the
	give me		a look at
	give me a
	give me a look
		me a look
		me a look at
			a look at the

Output 3

Please

see

that

knitted

sweater

for

me.

N-grams

Please	see	that	knitted	sweater	for	me.
Please	see	that		sweater
	see that

Output 4

Please

have

look

that

sweater

me.

N-grams

Please	have	a	look	at	that	sweater	to	me.
Please	have	a	look	at	that	sweater	to
	have a		look at
	have a look			at that
	have a look at
		a look
		a look at
		a look at that
			look at that

Sentence 71) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.6/0.25/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.5/0/0/0)

Source

�A��

��

��a

��s

��

�H

Ref 0

you

have

local

wine?

Ref 1

you

serve

local

wine?

Ref 2

there

any

local

wine?

Ref 3

you

keep

any

local

wine?

Ref 4

you

have

any

wine

from

this

area?

Ref 5

you

have

any

regional

wines?

Ref 6

you

have

any

wines

from

around

here?

Ref 7

Would

there

any

local

wines?

Ref 8

Are

there

any

local

wines?

Ref 9

you

serve

any

local

wines?

Ref 10

you

serve

local

wine?

Ref 11

Any

local

wine?

Ref 12

Would

you

have

any

local

wine?

Ref 13

you

carry

any

local

wines?

Ref 14

you

have

local

wine?

Ref 15

Are

there

any

local

wines?

Output 0

You

have

your

local

wine?

N-grams

You	have	your	local	wine?
	have		local	wine?
			local wine?

Output 1

you

have

local

wine

N-grams

you	have	local	wine	?
you	have	local	wine
you have
you have local
	have local

Output 2

You

have

your

local

wine?

N-grams

You	have	your	local	wine?
	have		local	wine?
			local wine?

Output 3

you

have

native

wine?

N-grams

Do	you	have	native	wine?
Do	you	have		wine?
Do you
Do you have
	you have

Output 4

You

have

the

local

grape

wine?

N-grams

You	have	the	local	grape	wine?
	have		local		wine?

Sentence 72) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.6667/0.375/0.1429/0) ; 0 (0.2/0/0/0)

Source

��

�O

��

�H

Ref 0

What

made

of?

Ref 1

What's

the

material

this?

Ref 2

What

made

from?

Ref 3

What

material

used

this?

Ref 4

What

are

the

materials?

Ref 5

What

was

used

make

it?

Ref 6

What

kind

material

it?

Ref 7

What's

made

from?

Ref 8

What

material

this?

Ref 9

What

material

made

from?

Ref 10

What

material

made

from?

Ref 11

What's

the

material

used?

Ref 12

What

material

it?

Ref 13

What

made

from?

Ref 14

What

does

constitute

of.

Ref 15

What

manufactured

from?

Output 0

what

made

of?

N-grams

It	is	what	made	of?
	is		made	of?
			made of?

Output 1

what

N-grams

it	is	what	?
it	is

Output 2

what

made

of?

N-grams

It	is	what	made	of?
	is		made	of?
			made of?

Output 3

What

does

use

make

into?

N-grams

What	does	it	be	to	use	to	make	into?
What	does	it		to		to make
What does							make
What does it
	does it

Output 4

makes

with

what?

N-grams

Is	it	makes	with	what?
	it

Sentence 73) BLEU: 0 (0.6/0.2222/0.125/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0.1429/0/0) ; 0 (0.6/0.2222/0.125/0) ; 0 (0.3333/0.09091/0/0)

Source

�q

�X�I

��

�X�I

�O

��~

�ɶ�

�H

Ref 0

From

what

time

what

time

are

the

business

hours?

Ref 1

What

are

the

hours

you

are

open?

Ref 2

What

are

your

business

hours?

Ref 3

From

what

time

what

time

you

open?

Ref 4

You

are

open

from

when

when?

Ref 5

What

are

your

hours

operation?

Ref 6

When

are

you

open

for

business?

Ref 7

From

when

are

your

hours

operation?

Ref 8

Can

you

tell

from

when

your

business

hours

are?

Ref 9

From

what

time

what

time

are

you

open?

Ref 10

What

are

your

business

hours?

Ref 11

When

you

open

and

when

you

close?

Ref 12

From

when

you

open?

Ref 13

When

you

open

and

close?

Ref 14

What

are

your

opening

and

closing

times?

Ref 15

What

are

your

hours

business?

Output 0

What

time

what

time

business

time?

N-grams

What	time	go	to	what	time	is	a	business	time?
What	time		to	what	time			business
			to what
			to what time
				what time

Output 1

from

business

N-grams

from	a	to	is	business	?
from		to		business

Output 2

From

few

hours

are?

N-grams

From	a	few	to	a	few	hours	are?
From			to			hours	are?
						hours are?

Output 3

What

time

what

time

business

time?

N-grams

What	time	go	to	what	time	is	a	business	time?
What	time		to	what	time			business
			to what
			to what time
				what time

Output 4

How

many

spots

from

how

many

spots

the

business

hour?

N-grams

How	many	spots	from	to	how	many	spots	is	the	business	hour?
			from	to					the	business
									the business

Sentence 74) BLEU: 0.5774 (0.9167/0.7273/0.5/0.3333) ; 0 (0.6667/0.2857/0.1538/0) ; 0.5774 (0.9167/0.7273/0.5/0.3333) ; 0 (0.5556/0.1765/0.0625/0) ; 0 (0.5/0.07692/0/0)

Source

��

�w�g

�ǳ�

�n

�H��

�}�l

�
��

�A

�ҥH

�u

�ݭn

��

�ɭ�

�C

Ref 0

I'm

ready

start

talks

anytime

just

say

when.

Ref 1

I'm

all

set

for

talk

anytime

let

know

when.

Ref 2

can

talk

with

you

whenever

you

are

ready,

please

tell

when.

Ref 3

Since

I'm

prepared

have

talk

with

you,

let

know

when

you're

OK.

Ref 4

I'm

prepared

begin

the

talks

anytime

just

give

the

go-ahead.

Ref 5

I'm

prepared

enter

into

the

negotiations

any

time

just

let

know.

Ref 6

I'm

ready

start

the

talks

anytime

just

say

the

word.

Ref 7

I'm

prepared

have

meeting

anytime,

just

tell

when.

Ref 8

Just

say

when,

I'm

ready

for

discussion

anytime.

Ref 9

I'm

ready

talk

anytime

and

just

waiting

for

the

ahead.

Ref 10

I'm

fully

prepared,

just

let

know

when

you

want

start

talks.

Ref 11

I've

finished

preparations,

please

tell

when

can

start

our

discussion.

Ref 12

I'm

ready

talk,

please

let

know

when

it's

okay

start

talking.

Ref 13

I'm

ready

begin

discussion

anytime

just

give

the

signal.

Ref 14

I'm

able

start

discussion

any

moment

whenever

you

say

you're

ready.

Ref 15

able

begins

discussion

anytime

the

moment

you

say,

"let's

talk."

Output 0

I'm

ready

start

talks

any

time,

just

say

when.

N-grams

I'm	ready	to	start	talks	at	any	time,	so	just	say	when.
I'm	ready	to	start	talks	at	any		so	just	say	when.
I'm ready		to start			at any			so just		say when.
I'm ready to			start talks					so just say
I'm ready to start								so just say when.
	ready to								just say
	ready to start								just say when.
	ready to start talks
		to start talks

Output 1

start

talks

any

time

say

when

already

only

N-grams

start

talks

any

time

say

when

already

only

start

talks

any

time

say

when

to start

at any

to start talks

at any time

start talks

any time

Output 2

I'm

ready

start

talks

any

time,

just

say

when.

N-grams

I'm	ready	to	start	talks	at	any	time,	so	just	say	when.
I'm	ready	to	start	talks	at	any		so	just	say	when.
I'm ready		to start			at any			so just		say when.
I'm ready to			start talks					so just say
I'm ready to start								so just say when.
	ready to								just say
	ready to start								just say when.
	ready to start talks
		to start talks

Output 3

have

already

very

prepare

start

talks

any

time,

only

need

said

when.

N-grams

have

already

very

prepare

start

talks

any

time,

only

need

said

when.

have

start

talks

any

when.

to start

at any

to start talks

start talks

Output 4

already

prepared

momentarily

start

discuss,

therefore

when

only

needed

say.

N-grams

already

prepared

momentarily

start

discuss,

therefore

when

only

needed

say.

prepared

start

when

to start

Sentence 75) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.6667/0.4/0/0) ; 0 (0.5/0/0/0)

Source

��

�R��

��

�H

Ref 0

Can

still

get

ticket?

Ref 1

Are

the

tickets

still

available?

Ref 2

still

possible

get

ticket?

Ref 3

you

still

sell

tickets?

Ref 4

Can

still

get

hands

ticket?

Ref 5

Can

still

get

hold

ticket?

Ref 6

Can

still

obtain

ticket?

Ref 7

still

possible

get

tickets?

Ref 8

Are

tickets

still

available?

Ref 9

Would

still

able

get

ticket?

Ref 10

still

have

time

get

ticket?

Ref 11

still

time

get

ticket?

Ref 12

still

okay

get

ticket?

Ref 13

still

possible

get

ticket?

Ref 14

Are

any

tickets

still

available?

Ref 15

Are

there

any

tickets

left?

Output 0

can

buy

ticket?

N-grams

I	can	buy	a	ticket?
I			a	ticket?
			a ticket?

Output 1

can

buy

ticket

also

N-grams

i	can	buy	a	ticket	also	?
			a

Output 2

can

buy

ticket?

N-grams

I	can	buy	a	ticket?
I			a	ticket?
			a ticket?

Output 3

Can

also

buy

ticket?

N-grams

Can	I	also	buy	a	ticket?
Can	I			a	ticket?
Can I				a ticket?

Output 4

can

also

buy

the

ticket?

N-grams

I	can	also	buy	the	ticket?
I				the	ticket?

Sentence 76) BLEU: 0.279 (0.75/0.3636/0.2/0.1111) ; 0 (0.6364/0.1/0/0) ; 0.279 (0.75/0.3636/0.2/0.1111) ; 0 (0.7857/0.4615/0.1667/0) ; 0.2788 (0.7333/0.4286/0.2308/0.08333)

Source

��

��D

�A

��

�Pı

�C

��

ť��

�L

�b

�Ǯ�

�S

��

�·�

�F

�C

Ref 0

know

how

you

feel.

heard

got

trouble

school

again.

Ref 1

can

understand

your

feeling.

heard

caused

trouble

school

again.

Ref 2

sympathize

with

you.

heard

caused

headaches

school

again.

Ref 3

understand

how

you

feel.

heard

posed

problems

school

again.

Ref 4

know

just

how

you're

feeling.

heard

he's

having

problems

school

again.

Ref 5

can

imagine

how

you

feel.

understand

he's

trouble

again

school.

Ref 6

can

sympathize

with

how

you

feel.

understand

he's

gotten

into

trouble

again

school.

Ref 7

feel

for

you.

got

wind

that

got

himself

trouble

school

again.

Ref 8

sympathize

with

you.

heard

that

something

wrong

happened

again

school.

Ref 9

must

hard

for

you.

heard

that

he's

trouble

again

school.

Ref 10

understand

how

you

feel.

Someone

told

that

was

trouble

again

school.

Ref 11

can

see

how

you

feel.

got

news

that

caused

problems

school

once

again.

Ref 12

understand

your

feelings.

learnt

that

caused

trouble

school.

Ref 13

know

well

how

you

are

feeling.

heard

encountering

problems

school

again.

Ref 14

understand

how

you

feel.

heard

was

having

problems

school

again.

Ref 15

understand

how

you

feel.

heard

got

into

trouble

school.

Output 0

know

you

feel.

heard

him

school

and

trouble.

N-grams

I	know	you	feel.	I	heard	him	in	school	and	in	trouble.
I	know	you	feel.	I	heard		in	school
I know		you feel.		I heard
		you feel. I
		you feel. I heard
			feel. I
			feel. I heard

Output 1

know

heard

school

your

feeling

that

N-grams

i	know	i	heard	in	school	your	feeling	that	he	.
	know		heard	in	school	your		that	he
								that he

Output 2

know

you

feel.

heard

him

school

and

trouble.

N-grams

I	know	you	feel.	I	heard	him	in	school	and	in	trouble.
I	know	you	feel.	I	heard		in	school
I know		you feel.		I heard
		you feel. I
		you feel. I heard
			feel. I
			feel. I heard

Output 3

know

your

feeling.

hear

that

wased

Dutch

again

school.

N-grams

know

your

feeling.

hear

that

wased

Dutch

again

school.

know

your

feeling.

that

again

school.

I know

your feeling.

that he

again at

your feeling. I

again at school.

feeling. I

at school.

Output 4

know

your

feeling.

heard

that

also

had

the

school

troublesome.

N-grams

know

your

feeling.

heard

that

also

had

the

school

troublesome.

know

your

feeling.

heard

that

school

I know

your feeling.

I heard

that he

your feeling. I

heard that

your feeling. I heard

feeling. I

feeling. I heard

I heard that

Sentence 77) BLEU: 1 (1/1/1/1) ; 0 (0.4286/0.1667/0/0) ; 1 (1/1/1/1) ; 0 (0.8333/0.6/0.25/0) ; 0 (0.625/0.1429/0/0)

Source

��

�p��

��

��W

��}

�C

Ref 0

plan

leaving

tomorrow

morning.

Ref 1

I'm

thinking

leaving

tomorrow

morning.

Ref 2

plan

leave

tomorrow

morning.

Ref 3

departure

scheduled

tomorrow

morning.

Ref 4

planning

going

tomorrow

morning.

Ref 5

It's

plan

depart

tomorrow,

the

morning.

Ref 6

supposed

leave

tomorrow

morning.

Ref 7

plan

leave

tomorrow

morning.

Ref 8

intend

leave

tomorrow

morning.

Ref 9

I'm

scheduled

leave

tomorrow

morning.

Ref 10

I'm

thinking

leaving

tomorrow

morning.

Ref 11

plan

leave

tomorrow

morning.

Ref 12

I'm

planning

leave

tomorrow

morning.

Ref 13

plan

leave

tomorrow

the

morning.

Ref 14

supposed

leave

tomorrow

morning.

Ref 15

departure

planned

for

tomorrow

morning.

Output 0

plan

leave

tomorrow

morning.

N-grams

I	plan	to	leave	tomorrow	morning.
I	plan	to	leave	tomorrow	morning.
I plan		to leave		tomorrow morning.
I plan to			leave tomorrow
I plan to leave
	plan to		leave tomorrow morning.
	plan to leave
	plan to leave tomorrow
		to leave tomorrow
		to leave tomorrow morning.

Output 1

plan

leave

tomorrow

morning

will

N-grams

i	plan	leave	tomorrow	morning	will	.
	plan	leave	tomorrow
		leave tomorrow

Output 2

plan

leave

tomorrow

morning.

N-grams

I	plan	to	leave	tomorrow	morning.
I	plan	to	leave	tomorrow	morning.
I plan		to leave		tomorrow morning.
I plan to			leave tomorrow
I plan to leave
	plan to		leave tomorrow morning.
	plan to leave
	plan to leave tomorrow
		to leave tomorrow
		to leave tomorrow morning.

Output 3

plan

will

leave

tomorrow

morning.

N-grams

My	plan	will	leave	tomorrow	morning.
My	plan		leave	tomorrow	morning.
My plan			leave tomorrow
			leave tomorrow morning.
				tomorrow morning.

Output 4

will

plan

leave

the

morning

tomorrow.

N-grams

I	will	plan	leave	in	the	morning	tomorrow.
I		plan	leave	in	the
				in the

Sentence 78) BLEU: 0.4273 (0.875/0.5714/0.3333/0.2) ; 0 (0.6/0.3333/0.125/0) ; 0.4671 (1/0.7143/0.3333/0.2) ; 0.2402 (0.7143/0.3077/0.1667/0.09091) ; 0 (1/0.3333/0/0)

Source

�A

�i�H

�b

�ۢ��

�R��

��

�C

��

�N

�b

��

�C

Ref 0

You

can

buy

Midorinomadoguchi.

It's

over

there.

Ref 1

It's

available

the

counter.

You

can

see

over

there.

Ref 2

You

can

get

the

counter.

It's

located

over

there.

Ref 3

You

can

purchase

the

counter.

It's

over

there.

Ref 4

You

can

get

Midorinomadoguchi.

It's

over

that

way.

Ref 5

You'll

able

purchase

Midorinomadoguchi.

that

direction

over

there.

Ref 6

You'll

able

get

one

Midorinomadoguchi.

It's

over

that

direction.

Ref 7

may

purchased

the

Midorinomadoguchi.

Right

over

there.

Ref 8

It's

possible

purchase

the

Midorinomadoguchi.

You

can

find

over

there.

Ref 9

You

can

get

the

Midorinomadoguchi.

Over

there.

Ref 10

It's

available

Midorinomadoguchi.

It's

just

there.

Ref 11

It's

sale

Midorinomadoguchi.

Just

over

there.

Ref 12

You'll

able

get

Midorinomadoguchi.

Over

there.

Ref 13

can

purchased

the

Midorinomadoguchi.

It's

over

there.

Ref 14

available

the

Midorinomadoguchi.

It's

the

other

side.

Ref 15

Midorinomadoguchi

sells

it.

It's

over

the

other

side.

Output 0

You

can

buy

midorinomadoguchi.

over

there.

N-grams

You	can	buy	it	midorinomadoguchi.	It	over	there.
You	can	buy	it		It	over	there.
You can		buy it				over there.
You can buy
You can buy it
	can buy
	can buy it

Output 1

you

can

buy

midorinomadoguchi

over

there

N-grams

you	can	buy	it	midorinomadoguchi	it	over	there	in	.
	can	buy	it		it	over		in
	can buy				it over
	can buy it
		buy it

Output 2

You

can

buy

Midorinomadoguchi.

over

there.

N-grams

You	can	buy	it	Midorinomadoguchi.	It	over	there.
You	can	buy	it	Midorinomadoguchi.	It	over	there.
You can		buy it		Midorinomadoguchi. It		over there.
You can buy
You can buy it
	can buy
	can buy it

Output 3

You

can

buy

the

��

the

�ۢ��

over

there.

N-grams

You

can

buy

the

��

the

�ۢ��

over

there.

You

can

buy

the

over

there.

You can

buy it

over there.

You can buy

You can buy it

can buy

can buy it

Output 4

You

may

buy

Midorinomadoguchi.

that

side.

N-grams

You	may	buy	it	in	Midorinomadoguchi.	It	in	that	side.
You	may	buy	it	in	Midorinomadoguchi.	It	in that		side.
		buy it			Midorinomadoguchi. It			that

Sentence 79) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.25/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.4286/0.1667/0/0)

Source

��

�Q

�n

�@

��

�y��

��

��\

�C

Ref 0

want

take

dinner

cruise.

Ref 1

I'd

take

dinner

cruise.

Ref 2

I'm

thinking

taking

dinner

cruise.

Ref 3

Can

take

dinner

cruise?

Ref 4

I'd

dinner

cruise.

Ref 5

I'd

out

dinner

cruise.

Ref 6

want

dinner

cruise.

Ref 7

I'd

dinner

cruise.

Ref 8

want

dinner

cruise.

Ref 9

I'm

interested

taking

dinner

cruise.

Ref 10

would

love

take

dinner

cruise.

Ref 11

would

great

have

dinner

cruise.

Ref 12

would

get

dinner

cruise.

Ref 13

wish

dinner

cruise.

Ref 14

wish

eat

dinner

cruise

ship.

Ref 15

would

dining

cruise.

Output 0

I'd

leisurely

supper.

N-grams

I'd	like	a	leisurely	supper.
I'd	like	a
I'd like

Output 1

leisurely

supper

want

and

carefree

N-grams

i	a	leisurely	supper	want	and	carefree	.
	a			want

Output 2

I'd

leisurely

supper.

N-grams

I'd	like	a	leisurely	supper.
I'd	like	a
I'd like

Output 3

want

leisurely

and

carefree

dinner.

N-grams

I	want	a	leisurely	and	carefree	dinner.
I	want	a
I want

Output 4

want

leisurely

and

carefree

supper.

N-grams

I	want	a	leisurely	and	carefree	supper.
I	want	a
I want

Sentence 80) BLEU: 0.8801 (1/1/0.8/0.75) ; 0 (0.625/0.4286/0.1667/0) ; 0.8801 (1/1/0.8/0.75) ; 0 (0.7143/0.6667/0.4/0) ; 0 (0.8571/0.8333/0.4/0)

Source

��

�Q

�A

�T�{

��

��Z

�C

Ref 0

I'd

reconfirm

flight.

Ref 1

Could

reconfirm

flight?

Ref 2

May

reconfirm

flight?

Ref 3

want

reconfirm

flight.

Ref 4

want

make

reconfirmation

flight.

Ref 5

About

flight,

I'd

reconfirm.

Ref 6

Please

reconfirm

flight.

Ref 7

May

reconfirm

flight,

please?

Ref 8

want

reconfirm

flight.

Ref 9

Please

reconfirm

flight.

Ref 10

would

appreciate

you

could

reconfirm

flight.

Ref 11

Could

you

please

reconfirm

flight?

Ref 12

Please

reconfirm

flight

for

me.

Ref 13

would

confirm

flight,

please.

Ref 14

would

check

flight,

please.

Ref 15

would

make

flight

confirmation,

please.

Output 0

would

confirm

flight.

N-grams

I	would	like	to	confirm	my	flight.
I	would	like	to	confirm	my	flight.
I would		like to		confirm my
I would like			to confirm		my flight.
I would like to
	would like		to confirm my
	would like to
	would like to confirm
		like to confirm
		like to confirm my

Output 1

confirm

flight

want

again

N-grams

i	to	confirm	my	flight	want	again	.
	to	confirm	my	flight	want
	to confirm		my flight
	to confirm my
		confirm my

Output 2

would

confirm

flight.

N-grams

I	would	like	to	confirm	my	flight.
I	would	like	to	confirm	my	flight.
I would		like to		confirm my
I would like			to confirm		my flight.
I would like to
	would like		to confirm my
	would like to
	would like to confirm
		like to confirm
		like to confirm my

Output 3

want

confirm

service

again.

N-grams

I	want	to	confirm	my	service	again.
I	want	to	confirm	my
I want		to confirm
I want to			confirm my
	want to
		to confirm my

Output 4

want

confirm

flight

again.

N-grams

I	want	to	confirm	my	flight	again.
I	want	to	confirm	my	flight
I want		to confirm		my flight
I want to			confirm my
	want to
		to confirm my

Sentence 81) BLEU: 0 (0.7/0.3333/0.125/0) ; 0 (0.6364/0.2/0/0) ; 0 (0.7778/0.5/0.2857/0) ; 0 (0.7/0.3333/0.125/0) ; 0 (0.5/0/0/0)

Source

��

�ݭn

��

�ɭ�

��e

�b

��

�n�O

�H

Ref 0

what

time

have

check

the

airport?

Ref 1

when

need

check

the

airport?

Ref 2

What

time

need

check

the

airport?

Ref 3

what

time

should

check

the

airport?

Ref 4

What's

the

latest

can

check

the

airport?

Ref 5

Airport

check

until

what

time?

Ref 6

Check

the

airport

would

until

what

time?

Ref 7

What

the

latest

that

must

check

the

airport?

Ref 8

when

must

check

the

airport?

Ref 9

what

time

required

check

the

airport?

Ref 10

Until

what

time

check-in

possible

the

airport?

Ref 11

Until

when

can

check

the

airport?

Ref 12

when

should

have

checked

the

airport?

Ref 13

What

the

latest

time

can

check

the

airport?

Ref 14

What

time

must

check

the

airport

by?

Ref 15

What

time

have

check

flight

the

airport?

Output 0

When

need

before

the

airport?

N-grams

When	do	I	need	before	to	register	in	the	airport?
	do	I	need		to		in	the	airport?
	do I							the airport?
	do I need
		I need

Output 1

before

when

need

the

airport

N-grams

before	when	i	need	to	register	the	airport	do	in	?
	when		need	to		the	airport	do	in
			need to			the airport

Output 2

Before

when

need

the

airport?

N-grams

Before	when	I	need	to	register	at	the	airport?
	when	I	need	to		at	the	airport?
		I need				at the
		I need to				at the airport?
			need to				the airport?

Output 3

When

need

before

the

airport?

N-grams

When	do	I	need	before	to	register	in	the	airport?
	do	I	need		to		in	the	airport?
	do I							the airport?
	do I need
		I need

Output 4

When

before

need,

airport

registration?

N-grams

When	before	I	do	need,	in	airport	registration?
		I	do		in	airport

Sentence 82) BLEU: 0 (0.2/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0/0/0/0)

Source

�q�v

�b

�X

�W�D

�H

Ref 0

Which

channel

the

movie

on?

Ref 1

which

channel

can

see

the

movie?

Ref 2

Which

channel

the

movie

on?

Ref 3

Which

channel

the

movie

showing

on?

Ref 4

What

channel

the

movie

on?

Ref 5

What

station

the

movie

on?

Ref 6

Which

station

will

find

the

movie

on?

Ref 7

Can

you

tell

which

channel

the

movie

on?

Ref 8

Which

channel

turn

for

the

movie?

Ref 9

Please

tell

which

channel

should

for

the

movie.

Ref 10

which

channel

may

watch

the

movie?

Ref 11

Which

channel

have

turn

watch

the

movie?

Ref 12

Which

the

movie

channel?

Ref 13

What

channel

the

movie

playing

on?

Ref 14

What

channel

can

hear

the

movie

on?

Ref 15

What

channel

the

movie?

Output 0

few

movie

channels?

N-grams

In	a	few	movie	channels?
			movie

Output 1

movie

channels

N-grams

in	movie	channels	?
	movie

Output 2

few

movie

channels?

N-grams

In	a	few	movie	channels?
			movie

Output 3

the

movie

several

channels?

N-grams

Is	the	movie	in	several	channels?
	the	movie
	the movie

Output 4

Movie

how

many

channels?

N-grams

Movie

how

many

channels?

Sentence 83) BLEU: 0 (0.4/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.4/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.5/0/0/0)

Source

��

��W

��

�ж�

�C

Ref 0

Please

keep

room

key.

Ref 1

Would

you

please

keep

room

key?

Ref 2

possible

ask

you

keep

room

key?

Ref 3

Could

you

keep

room

key?

Ref 4

Could

you

keep

key

for

me?

Ref 5

Could

you

take

care

key,

please?

Ref 6

Would

you

please

hold

onto

key

for

me?

Ref 7

you

mind

keeping

room

key?

Ref 8

Could

you

hang

room

key?

Ref 9

May

leave

room

key

with

you?

Ref 10

Can

you

keep

room

key

for

me?

Ref 11

Could

you

please

hold

room

key?

Ref 12

I'd

you

keep

room

key

for

me.

Ref 13

Please

take

care

room

key,

please.

Ref 14

Please

hold

room

key,

please.

Ref 15

Please

keep

the

key

for

me,

please.

Output 0

Please

locked

room.

N-grams

Please	locked	in	my	room.
Please			my

Output 1

please

room

lock

N-grams

please	my	room	lock	.
please	my	room
	my room

Output 2

Please

locked

room.

N-grams

Please	locked	in	my	room.
Please			my

Output 3

Please

lock

room.

N-grams

Please	lock	up	my	room.
Please			my

Output 4

Please

lock

room.

N-grams

Please	lock	my	room.
Please		my

Sentence 84) BLEU: 0 (1/0.8333/0.4/0) ; 0 (0.6667/0.2/0/0) ; 0.4111 (0.5714/0.5/0.4/0.25) ; 0 (1/0.8333/0.4/0) ; 0 (0.5/0.4/0.25/0)

Source

�A��

��N

��

�[�J

�A��

��

�H

Ref 0

you

mind

join

you?

Ref 1

May

join

you?

Ref 2

Would

you

mind

sharing?

Ref 3

alright

join

you?

Ref 4

Would

you

mind

the

table?

Ref 5

all

right

sit

your

table?

Ref 6

Would

for

your

table?

Ref 7

Would

you

mind

sat

here?

Ref 8

Would

you

okay

with

joining

you?

Ref 9

okay

sit

here?

Ref 10

okay

join

you?

Ref 11

Would

you

mind

joined

you?

Ref 12

Can

join

you?

Ref 13

this

seat

taken?

Ref 14

May

sit

with

you?

Ref 15

May

sit

here?

Output 0

you

mind

join

you?

N-grams

Do	you	mind	me	to	join	you?
Do	you	mind	me	to	join	you?
Do you			me to		join you?
Do you mind				to join
	you mind			to join you?

Output 1

you

mind

join

N-grams

you	you	mind	i	join	?
you	you mind			join
		mind

Output 2

You

you

mind

add

it?

N-grams

You	you	mind	if	I	add	it?
	you	mind	if	I
	you mind		if I
	you mind if
	you mind if I
		mind if
		mind if I

Output 3

you

mind

join

you?

N-grams

Do	you	mind	me	to	join	you?
Do	you	mind	me	to	join	you?
Do you			me to		join you?
Do you mind				to join
	you mind			to join you?

Output 4

You

minded

that

join

you?

N-grams

You	minded	that	I	join	you?
			I	join	you?
			I join
			I join you?
				join you?

Sentence 85) BLEU: 0 (0.5/0.4/0.25/0) ; 0 (0.75/0.6667/0.5/0) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.5/0.4/0.25/0) ; 0 (0.25/0/0/0)

Source

��

�M

�@

��

�C

Ref 0

wrist

watch

and

Japanese

fan.

Ref 1

Here

wrist

watch

and

folding

fan.

Ref 2

This

wrist

watch

and

folding

fan.

Ref 3

watch

and

folding

fan.

Ref 4

watch

and

fold-up

fan.

Ref 5

watch

and

fan.

Ref 6

I've

got

watch

and

Japanese

fan.

Ref 7

have

watch

and

Japanese

fan.

Ref 8

I'm

bringing

back

watch

and

Japanese

fan.

Ref 9

have

wrist

watch

and

Japanese

fan.

Ref 10

Just

wrist

watch

and

Japanese

fan.

Ref 11

I've

got

wrist

watch

and

Japanese

fan.

Ref 12

have

watch

and

Japanese

fan.

Ref 13

It's

watch

and

Japanese

folding

fan.

Ref 14

watch

and

Japanese

folding

fan.

Ref 15

wrist

watch

and

Japanese

fan.

Output 0

watch

and

admire

day.

N-grams

A	watch	and	an	admire	day.
A	watch	and
A watch
A watch and
	watch and

Output 1

watch

and

N-grams

a	watch	and	.
a	watch	and
a watch
a watch and
	watch and

Output 2

watch

and

har

persons.

N-grams

A	watch	and	a	har	persons.
A	watch	and	a
A watch		and a
A watch and
A watch and a
	watch and
	watch and a

Output 3

watch

and

admire

day.

N-grams

A	watch	and	an	admire	day.
A	watch	and
A watch
A watch and
	watch and

Output 4

Wristwatch

and

one

date.

N-grams

Wristwatch	and	one	date.
	and

Sentence 86) BLEU: 0.5373 (0.7/0.5556/0.5/0.4286) ; 0 (0.5556/0.25/0/0) ; 0.5373 (0.7/0.5556/0.5/0.4286) ; 0 (0.5/0.1111/0/0) ; 0 (0.6667/0.125/0/0)

Source

��

�[�J

��

�C�I

��Z

��

�W��

�C

Ref 0

Please

put

the

waiting

list

for

flight

seven.

Ref 1

Could

you

put

the

waiting

list

for

flight

seven?

Ref 2

Can

wait

and

see

seat

opens

up?

Ref 3

Would

you

write

name

down

the

waiting

list?

Ref 4

Could

you

please

add

the

waiting

list

for

flight

seven?

Ref 5

Please

put

name

the

waiting

list

for

flight

seven.

Ref 6

Would

you

put

down

the

waiting

list

for

flight

seven?

Ref 7

Can

you

put

standby

for

flight

number

seven?

Ref 8

I'd

put

standby

for

flight

number

seven,

please.

Ref 9

Can

put

the

waiting

list

for

flight

seven?

Ref 10

Can

you

put

the

waiting

list

for

flight

seven?

Ref 11

Would

you

mind

adding

the

waiting

list

for

flight

seven?

Ref 12

Kindly

include

the

waiting

list

for

flight

seven.

Ref 13

would

placed

the

waitlist

for

flight

seven,

please.

Ref 14

would

the

waitlist

for

flight

seven,

please.

Ref 15

Please

put

name

the

waitlist

for

flight

seven,

please.

Output 0

Please

add

the

waiting

list

seven

flights.

N-grams

Please	add	me	to	the	waiting	list	of	seven	flights.
Please	add	me	to	the	waiting	list
	add me		to the		waiting list
	add me to			the waiting
	add me to the
		me to		the waiting list
		me to the
		me to the waiting
			to the waiting
			to the waiting list

Output 1

please

waiting

list

seven

join

N-grams

please	me	to	waiting	list	of	seven	join	.
please	me	to	waiting	list
	me to		waiting list

Output 2

Please

add

the

waiting

list

seven

flights.

N-grams

Please	add	me	to	the	waiting	list	of	seven	flights.
Please	add	me	to	the	waiting	list
	add me		to the		waiting list
	add me to			the waiting
	add me to the
		me to		the waiting list
		me to the
		me to the waiting
			to the waiting
			to the waiting list

Output 3

Please

join

waiting

for

7:00

service

list.

N-grams

Please	join	me	to	waiting	for	of	7:00	service	list.
Please		me	to	waiting	for
		me to

Output 4

Please

join

seven

flight

waiting

name

lists.

N-grams

Please	join	me	to	seven	flight	waiting	name	lists.
Please		me	to		flight	waiting	name
		me to

Sentence 87) BLEU: 0 (0.8/0.5/0/0) ; 0 (0.4/0/0/0) ; 0 (1/0.75/0/0) ; 0 (0.8/0.5/0/0) ; 0 (0.75/0.6667/0/0)

Source

��

�H

��

�w�g

�w�q

�F

�C

Ref 0

Why?

made

reservation.

Ref 1

How

come?

already

booked.

Ref 2

Why

that?

reserved

already.

Ref 3

What

made

you

say

so?

did

the

booking.

Ref 4

How

come?

made

reservations

ahead

time.

Ref 5

Why

that?

called

ahead

and

made

reservations.

Ref 6

Why

would

that

be?

made

reservations

advance.

Ref 7

How

come?

did

make

reservation,

you

know.

Ref 8

Why

that?

I've

made

reservations.

Ref 9

Can

you

tell

why?

booked

ahead,

you

know.

Ref 10

How

come?

have

reservation.

Ref 11

Why's

that?

made

booking

Ref 12

How

could

that

be?

had

already

made

reservation.

Ref 13

Why

that?

have

reservation.

Ref 14

For

what

reason?

reserved

ahead

time.

Ref 15

Why?

There's

reservation

for

me.

Output 0

Why?

have

already

reserved.

N-grams

Why?	I	have	already	reserved.
Why?	I	have	already
Why? I
	I have

Output 1

why

have

already

N-grams

why	i	have	already	.
		have	already

Output 2

Why?

have

already

booked.

N-grams

Why?	I	have	already	booked.
Why?	I	have	already	booked.
Why? I			already booked.
	I have

Output 3

Why?

have

already

reserved.

N-grams

Why?	I	have	already	reserved.
Why?	I	have	already
Why? I
	I have

Output 4

Why?

already

ordered.

N-grams

Why?	I	already	ordered.
Why?	I	already
Why? I
	I already

Sentence 88) BLEU: 0 (0.4/0/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.6/0.3333/0.125/0) ; 0 (0.2857/0.1667/0/0)

Source

��

�n

��

�ɶ�

��

�H

Ref 0

Will

take

long?

Ref 1

Will

long

time?

Ref 2

Will

take

long

time?

Ref 3

going

take

long

time?

Ref 4

Will

take

long

time?

Ref 5

Will

take

quite

while?

Ref 6

Does

take

long

time?

Ref 7

Will

while?

Ref 8

you

think

it'll

take

long

time?

Ref 9

Will

long?

Ref 10

Will

long

process?

Ref 11

Will

take

lot

time?

Ref 12

this

going

take

long?

Ref 13

Will

take

long

time?

Ref 14

Will

while?

Ref 15

Will

take

time?

Output 0

takes

very

long?

N-grams

It	takes	a	very	long?
		a		long?

Output 1

very

long

spend

time

N-grams

it	a	very	long	spend	time	?
it	a		long

Output 2

takes

very

long?

N-grams

It	takes	a	very	long?
		a		long?

Output 3

Does

want

spend

very

for

long

time?

N-grams

Does	it	want	to	spend	very	for	a	long	time?
Does	it		to				a	long	time?
Does it							a long
							a long time?
								long time?

Output 4

must

spend

the

very

long

time?

N-grams

It	must	spend	the	very	long	time?
					long	time?
					long time?

Sentence 89) BLEU: 0.4111 (0.75/0.5714/0.3333/0.2) ; 0 (0.5/0.3333/0/0) ; 0 (0.3333/0/0/0) ; 0.3549 (0.6667/0.5/0.2857/0.1667) ; 0 (0.3333/0/0/0)

Source

�W��

��

�O��

�O

�h��

�H

Ref 0

How

much

the

excess

baggage

charge?

Ref 1

How

much

have

pay

the

excess

baggage

charge?

Ref 2

How

much

you

charge

for

the

excess

baggage?

Ref 3

How

much

get

charged

for

excess

baggage?

Ref 4

What's

the

charge

for

excess

baggage?

Ref 5

How

much

the

overweight

charge

for

baggage?

Ref 6

What

you

charge

for

excess

baggage?

Ref 7

What's

the

cost

for

excess

baggage?

Ref 8

What

will

the

excess

baggage

charge

be?

Ref 9

How

much

for

the

excess

baggage

charge?

Ref 10

How

much

have

pay

for

excess

baggage?

Ref 11

How

much

for

excess

baggage?

Ref 12

What

the

excess

baggage

charge?

Ref 13

How

have

pay

for

excess

baggage?

Ref 14

How

much

the

charge

for

extra

luggage?

Ref 15

How

much

the

fee

for

extra

baggage?

Output 0

How

much

the

expenses

excess

baggage?

N-grams

How	much	is	the	expenses	of	excess	baggage?
How	much	is	the			excess	baggage?
How much		is the				excess baggage?
How much is
How much is the
	much is
	much is the

Output 1

excess

baggage

how

N-grams

excess	baggage	how	?
excess	baggage
excess baggage

Output 2

Excess

baggage

cost?

N-grams

Excess	baggage	cost?
	baggage

Output 3

How

much

the

expenses

excess

baggage

N-grams

How	much	is	the	expenses	of	excess	baggage	?
How	much	is	the			excess	baggage
How much		is the				excess baggage
How much is
How much is the
	much is
	much is the

Output 4

How

many

are

excess

luggage's

expense?

N-grams

How	many	are	excess	luggage's	expense?
How			excess

Sentence 90) BLEU: 0 (0.3333/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0.3333/0/0)

Source

��

��H��

�C

Ref 0

Two

adult

tickets,

please.

Ref 1

Can

have

two

adult

tickets?

Ref 2

Could

have

two

adult

tickets?

Ref 3

I'd

two

adult

tickets,

please.

Ref 4

Tickets

for

two

adults,

please.

Ref 5

Please

give

tickets

for

two,

both

adults.

Ref 6

Tickets

for

both

us,

adult,

please.

Ref 7

For

two

adults,

please.

Ref 8

Two

adults,

please.

Ref 9

I'd

two

adult

tickets,

please.

Ref 10

I'd

tickets

for

two

adults.

Ref 11

Could

have

two

adult

tickets?

Ref 12

May

have

tickets

for

two

adults?

Ref 13

Tickets

for

two

adults,

please.

Ref 14

would

two

adult

tickets,

please.

Ref 15

Admission

for

two

adults,

please.

Output 0

Please

come

two

adult's

tickets.

N-grams

Please	come	to	two	adult's	tickets.
Please			two

Output 1

two

adult

tickets

N-grams

two	adult	tickets	.
two	adult	tickets
two adult

Output 2

Invited

two

adult

ticket.

N-grams

Invited	two	adult	ticket.
	two	adult
	two adult

Output 3

Please

come

two

adult's

tickets.

N-grams

Please	come	to	two	adult's	tickets.
Please			two

Output 4

Invites

two

adult

tickets.

N-grams

Invites	two	adult	tickets.
	two	adult
	two adult

Sentence 91) BLEU: 0.7953 (1/0.8/0.75/0.6667) ; 0 (0.5714/0.3333/0.2/0) ; 0 (1/0.6/0.25/0) ; 0.7953 (1/0.8/0.75/0.6667) ; 0 (1/0.3333/0/0)

Source

��

�]�k

�h

��

�H

Ref 0

Can

try

get

there?

Ref 1

you

mind

try

get

there?

Ref 2

Can

climb

there?

Ref 3

alright

climb

there?

Ref 4

May

try

climb

up?

Ref 5

Can

see

can

get

there?

Ref 6

attempt

get

there?

Ref 7

okay

try

and

get

there?

Ref 8

Can

try

getting

there?

Ref 9

Would

you

mind

tried

getting

there?

Ref 10

May

climb

up?

Ref 11

Would

okay

get

there?

Ref 12

Would

you

mind

getting

there?

Ref 13

May

try

climb

there?

Ref 14

alright

try

there?

Ref 15

May

try

there?

Output 0

Can

try

there?

N-grams

Can	I	try	to	go	there?
Can	I	try	to	go	there?
Can I		try to
Can I try			to go
Can I try to
	I try
	I try to
	I try to go
		try to go

Output 1

can

try

there

N-grams

i	can	try	to	go	there	?
	can	try	to	go
		try to
		try to go
			to go

Output 2

can

try

there?

N-grams

I	can	try	to	go	there?
I	can	try	to	go	there?
I can		try to
		try to go
			to go

Output 3

Can

try

there?

N-grams

Can	I	try	to	go	there?
Can	I	try	to	go	there?
Can I		try to
Can I try			to go
Can I try to
	I try
	I try to
	I try to go
		try to go

Output 4

can

try

there?

N-grams

I	can	try	there?
I	can	try	there?
I can

Sentence 92) BLEU: 0 (0.2857/0.1667/0/0) ; 0 (0.5/0.4/0.25/0) ; 0 (0.2857/0.1667/0/0) ; 0 (0.7143/0.3333/0.2/0) ; 0.4347 (0.7143/0.5/0.4/0.25)

Source

��

�@

��

��O

�K

��

�H

Ref 0

Can

have

note

pad?

Ref 1

Can

have

some

scrap

paper?

Ref 2

Can

have

some

paper

take

notes

on?

Ref 3

Can

you

give

note

pad?

Ref 4

Could

get

some

note

paper?

Ref 5

May

have

some

message

paper?

Ref 6

Could

you

give

note

pad?

Ref 7

Would

you

give

some

blank

paper?

Ref 8

you

have

some

notepaper?

Ref 9

Could

get

note

pad?

Ref 10

Would

you

mind

handing

note

pad?

Ref 11

note

pad,

please.

Ref 12

Could

you

get

note

pad?

Ref 13

May

get

note

pad?

Ref 14

May

have

scribble

pad?

Ref 15

May

get

memo

pad?

Output 0

Give

scratch

pad

notebook

it?

N-grams

Give	me	a	scratch	pad	notebook	it?
	me	a
	me a

Output 1

give

can

book

N-grams

give	me	a	can	book	?
give	me	a
give me
give me a
	me a

Output 2

Give

Scratch

Pad

notebook

it?

N-grams

Give	me	a	Scratch	Pad	notebook	it?
	me	a
	me a

Output 3

Can

give

notes

notepaper

book?

N-grams

Can	give	me	a	notes	notepaper	book?
Can	give	me	a	notes
	give me
	give me a
		me a

Output 4

Can

give

note

notepad

book?

N-grams

Can	give	me	a	note	notepad	book?
Can	give	me	a	note
	give me		a note
	give me a
	give me a note
		me a
		me a note

Sentence 93) BLEU: 0 (1/0.6667/0.5/0) ; 0 (0.6/0/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.8/0.25/0/0) ; 0 (1/0.6667/0.5/0)

Source

��M

�C

��

�O

��

�H

Ref 0

Sure.

What

it?

Ref 1

OK.

What

it?

Ref 2

Alright.

What's

up?

Ref 3

Sure.

What?

Ref 4

course.

What's

about?

Ref 5

Certainly.

Regarding

what?

Ref 6

You

bet.

What

can

for

you?

Ref 7

course.

What's

about?

Ref 8

problem.

What

would

you

do?

Ref 9

You

bet.

Just

tell

what

you

want.

Ref 10

problem.

How

can

help?

Ref 11

ahead.

How

can

help?

Ref 12

That's

fine.

What

can

for

you?

Ref 13

Yes.

What

kind

favor?

Ref 14

Okay.

What

may

for

you?

Ref 15

Okay.

What

may

help

you

with?

Output 0

Certainly.

What

it?

N-grams

Certainly.	What	is	it?
Certainly.	What	is	it?
	What is
	What is it?
		is it?

Output 1

what

certainly

N-grams

what	is	it	certainly	?
what	is	it

Output 2

當然.

What

it?

N-grams

當然.	What	is	it?
	What	is	it?
	What is
	What is it?
		is it?

Output 3

Certainly.

What

N-grams

Certainly.	What	is	it	?
Certainly.	What	is	it
	What is

Output 4

Certainly.

What

it?

N-grams

Certainly.	What	is	it?
Certainly.	What	is	it?
	What is
	What is it?
		is it?

Sentence 94) BLEU: 1 (1/1/1/1) ; 0 (0.6/0.25/0/0) ; 0 (1/0.75/0.3333/0) ; 1 (1/1/1/1) ; 0 (1/0.5/0/0)

Source

��

�S��

�Y

�o��

�C

Ref 0

didn't

eat

this.

Ref 1

This

something

didn't

eat.

Ref 2

This

food

was

not

eaten

me.

Ref 3

didn't

eat

this

food.

Ref 4

didn't

have

any

this.

Ref 5

didn't

touch

this.

Ref 6

didn't

eat

any

this

all.

Ref 7

haven't

eaten

this.

Ref 8

didn't

touch

this.

Ref 9

This

hasn't

been

touched.

Ref 10

haven't

eaten

this.

Ref 11

haven't

tried

this

yet.

Ref 12

didn't

taste

this

one.

Ref 13

didn't

have

this.

Ref 14

did

not

dine

this.

Ref 15

This

not

what

ate.

Output 0

didn't

eat

this.

N-grams

I	didn't	eat	this.
I	didn't	eat	this.
I didn't		eat this.
I didn't eat
I didn't eat this.
	didn't eat
	didn't eat this.

Output 1

not

eat

this

N-grams

i	not	eat	this	.
	not	eat	this
		eat this

Output 2

did

not

eat

this.

N-grams

I	did	not	eat	this.
I	did	not	eat	this.
I did			eat this.
I did not
	did not

Output 3

didn't

eat

this.

N-grams

I	didn't	eat	this.
I	didn't	eat	this.
I didn't		eat this.
I didn't eat
I didn't eat this.
	didn't eat
	didn't eat this.

Output 4

have

not

eaten

this.

N-grams

I	have	not	eaten	this.
I	have	not	eaten	this.
		not eaten
			eaten this.

Sentence 95) BLEU: 0 (1/0.75/0/0) ; 0 (0.2857/0/0/0) ; 0 (1/0.75/0/0) ; 0 (0.6/0.1111/0/0) ; 0 (0.8/0.25/0/0)

Source

�o��

�O

��

�դh

��

�줽��

�C

Ref 0

Doctor

Spock's

office.

Ref 1

This

Doctor

Spock's

office.

Ref 2

This

the

office

Doctor

Spock.

Ref 3

Doctor

Spock's.

Ref 4

This

Doctor

Spock's

office.

Ref 5

Dr.

Spock's

clinic.

Ref 6

Doctor

Spock's

clinic.

Ref 7

This

the

office

Doctor

Spock.

Ref 8

This

Doctor

Spock's

office.

Ref 9

Here

Doctor's

Spock's

surgery.

Ref 10

This

the

surgery

run

Doctor

Spock.

Ref 11

Doctor

Spock's

medical

clinic.

Ref 12

This

Doctor

Spock's

clinic.

Ref 13

Doctor

Spock's

physician's

office.

Ref 14

Doctor

Spock's

office.

Ref 15

Doctor

Spock's

office.

Output 0

Here

Dr.

Spock's

office.

N-grams

Here	is	Dr.	Spock's	office.
Here	is	Dr.	Spock's	office.
Here is		Dr. Spock's
			Spock's office.

Output 1

here

dr.

spock

office

N-grams

here	is	dr.	spock	's	office	.
	is				office

Output 2

Here

Dr.

Spock's

office.

N-grams

Here	is	Dr.	Spock's	office.
Here	is	Dr.	Spock's	office.
Here is		Dr. Spock's
			Spock's office.

Output 3

the

��

the

��

Doctor's

office

here.

N-grams

It	is	the	��	of	the	��	Doctor's	office	here.
	is	the		of			Doctor's	office
	is the

Output 4

Here

Dr.

Spock

office.

N-grams

Here	is	Dr.	Spock	office.
Here	is	Dr.		office.
Here is

Sentence 96) BLEU: 0 (1/1/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (1/1/0/0) ; 0 (0.3333/0/0/0)

Source

��n

��

�C

Ref 0

Don't

worry.

Ref 1

worries.

Ref 2

problem.

Ref 3

Don't

mention

it.

Ref 4

It's

OK.

Ref 5

Never

mind.

Ref 6

It's

fine.

Ref 7

It's

problem.

Ref 8

worries.

Ref 9

Don't

give

second

thought.

Ref 10

It's

okay.

Ref 11

problem.

Ref 12

Not

worry.

Ref 13

It's

alright.

Ref 14

It's

okay.

Ref 15

problem.

Output 0

Don't

worry.

N-grams

Don't	worry.
Don't	worry.
Don't worry.

Output 1

not

worry

N-grams

not

worry

Output 2

not

worry.

N-grams

Do	not	worry.
		worry.

Output 3

Don't

worry.

N-grams

Don't	worry.
Don't	worry.
Don't worry.

Output 4

not

worry.

N-grams

Do	not	worry.
		worry.

Sentence 97) BLEU: 0.8409 (1/0.875/0.8571/0.6667) ; 0 (0.7778/0.375/0/0) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.7778/0.25/0.1429/0) ; 0.8409 (1/0.875/0.8571/0.6667)

Source

��

�Q

�w��

�@�U

�z�v

�C

Ref 0

I'd

make

appointment

for

haircut.

Ref 1

want

make

appointment

for

haircut.

Ref 2

want

make

appointment

get

haircut.

Ref 3

would

make

appointment

for

haircut.

Ref 4

want

make

haircut

appointment.

Ref 5

need

make

appointment

get

hair

cut.

Ref 6

I'm

hoping

get

appointment

for

haircut.

Ref 7

want

make

appointment

have

haircut.

Ref 8

Can

make

appointment

get

haircut?

Ref 9

Could

book

appointment

for

haircut,

please?

Ref 10

Could

make

appointment

for

haircut?

Ref 11

want

appointment

cut

hair.

Ref 12

wish

make

appointment

have

hair

cut.

Ref 13

would

make

appointment

for

trim.

Ref 14

Could

make

appointment

for

haircut?

Ref 15

would

appointment

for

cut.

Output 0

want

make

appointment

cut

hair.

N-grams

I	want	to	make	an	appointment	to	cut	hair.
I	want	to	make	an	appointment	to	cut	hair.
I want		to make		an appointment		to cut
I want to			make an		appointment to
I want to make				an appointment to
	want to		make an appointment
	want to make				appointment to cut
	want to make an
		to make an
		to make an appointment
			make an appointment to

Output 1

appointment

want

cut

hair

N-grams

i	a	appointment	want	to	to	cut	hair	.
	a	appointment	want	to	to	cut	hair
	a appointment		want to		to cut

Output 2

think

about

haircut

appointment.

N-grams

I	think	about	a	haircut	appointment.
I			a	haircut	appointment.
			a haircut
			a haircut appointment.
				haircut appointment.

Output 3

want

reserve

while

cut

hair.

N-grams

I	want	to	reserve	to	a	while	cut	hair.
I	want	to		to	a		cut	hair.
I want
I want to
	want to

Output 4

want

make

appointment

cut

hair.

N-grams

I	want	to	make	an	appointment	to	cut	hair.
I	want	to	make	an	appointment	to	cut	hair.
I want		to make		an appointment		to cut
I want to			make an		appointment to
I want to make				an appointment to
	want to		make an appointment
	want to make				appointment to cut
	want to make an
		to make an
		to make an appointment
			make an appointment to

Sentence 98) BLEU: 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0) ; 0 (0/0/0/0)

Source

��

�C

Ref 0

Right.

Ref 1

That's

right.

Ref 2

Exactly.

Ref 3

Yes.

Ref 4

That's

right.

Ref 5

That's

true.

Ref 6

Sure.

Ref 7

That's

true.

Ref 8

see.

Ref 9

Good

point.

Ref 10

Fine.

Ref 11

Okay.

Ref 12

All

right.

Ref 13

That's

true.

Ref 14

seems

so.

Ref 15

seems

it.

Output 0

Right.

N-grams

Right.

Output 1

right

N-grams

right

Output 2

Right.

N-grams

Right.

Output 3

Right.

N-grams

Right.

Output 4

N-grams

Sentence 99) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0.5714/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5714/0/0/0)

Source

�A

�Q

��

�I

��

�H

Ref 0

What

would

you

drink?

Ref 1

What

will

you

have

drink?

Ref 2

What

drink

would

you

like?

Ref 3

What

will

you

having

drink?

Ref 4

What'll

you

have

drink?

Ref 5

you

know

what

you'd

have

drink?

Ref 6

What

kind

drink

would

you

like?

Ref 7

What

will

you

have

drink?

Ref 8

What

are

you

going

have

drink?

Ref 9

there

something

you'd

drink?

Ref 10

What

drink

would

you

order?

Ref 11

What

will

you

have

drink?

Ref 12

What

can

get

you

drink?

Ref 13

What

will

you

drink?

Ref 14

What

will

you

drinking?

Ref 15

What

may

bring

you

drink?

Output 0

You

want

drink?

N-grams

You	want	to	drink?
		to	drink?
		to drink?

Output 1

you

want

drink

what

N-grams

you	want	to	drink	what	do	?
you		to	drink	what

Output 2

You

want

drink?

N-grams

You	want	to	drink?
		to	drink?
		to drink?

Output 3

What

you

want

drink

point?

N-grams

What	do	you	want	to	drink	a	point?
What		you		to	drink

Output 4

What

you

want

drink

select?

N-grams

What	do	you	want	to	drink	select?
What		you		to	drink

Sentence 100) BLEU: 0 (0.75/0.4286/0.1667/0) ; 0 (0.6/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.75/0.4286/0.1667/0)

Source

�L

��

�_��

�S��

�k�H

��

�C

Ref 0

doesn't

look

woman.

Ref 1

don't

think

looks

woman.

Ref 2

don't

think

looks

womanly.

Ref 3

doesn't

look

woman.

Ref 4

doesn't

look

female.

Ref 5

doesn't

appear

woman

me.

Ref 6

don't

think

looks

woman.

Ref 7

does

not

seem

woman.

Ref 8

does

not

have

feminine

characteristics.

Ref 9

doesn't

have

attributes

that

are

womanly.

Ref 10

doesn't

appear

woman.

Ref 11

He's

not

womanly.

Ref 12

isn't

woman.

Ref 13

doesn't

look

feminine.

Ref 14

doesn't

appear

feminine.

Ref 15

isn't

feminine

looking.

Output 0

looks

does

not

have

the

effeminacy.

N-grams

He	looks	like	does	not	have	the	effeminacy.
He	looks	like	does	not	have
	looks like		does not
			does not have
				not have

Output 1

looks

have

N-grams

he	no	looks	have	.
he		looks	have

Output 2

appears

female

popularity.

N-grams

He	appears	no	female	popularity.
He

Output 3

looks

have

woman

spirit.

N-grams

He	looks	have	no	woman	spirit.
He	looks	have		woman

Output 4

looks

does

not

have

the

effeminacy.

N-grams

He	looks	like	does	not	have	the	effeminacy.
He	looks	like	does	not	have
	looks like		does not
			does not have
				not have

Sentence 101) BLEU: 0.5411 (0.75/0.5714/0.5/0.4) ; 0 (0.5556/0.125/0/0) ; 0.5411 (0.75/0.5714/0.5/0.4) ; 0 (0.4444/0.125/0/0) ; 0 (0.6/0.2222/0/0)

Source

�X

��

��@�T��

��

�ڭ�

�a

��

�H

Ref 0

What

number

bus

will

take

the

city?

Ref 1

What

the

number

the

bus

that

will

take

the

city?

Ref 2

What

number

bus

goes

the

city?

Ref 3

Which

bus

will

take

the

city?

Ref 4

What

the

number

the

bus

that

goes

into

town?

Ref 5

What

the

number

the

bus

that

takes

you

into

the

city?

Ref 6

What

the

number

for

the

bus

going

into

the

city?

Ref 7

What

number

bus

goes

the

city?

Ref 8

Which

number

bus

takes

you

the

city?

Ref 9

What

number

the

bus

that

goes

into

the

city?

Ref 10

What's

the

number

the

bus

going

into

the

city?

Ref 11

What's

the

number

the

city-bound

bus?

Ref 12

What

number

bus

have

take

for

the

city

center?

Ref 13

What's

the

number

the

bus

that

goes

into

the

city?

Ref 14

What's

the

number

the

bus

which

will

take

into

town?

Ref 15

What's

the

number

the

bus

that's

headed

into

the

city?

Output 0

Several

bus

can

take

the

city?

N-grams

Several	bus	can	take	us	to	the	city?
	bus		take	us	to	the	city?
			take us		to the
			take us to			the city?
			take us to the
				us to
				us to the
				us to the city?
					to the city?

Output 1

several

bus

can

city

number

bring

N-grams

several	bus	can	us	to	city	number	bring	?
	bus		us	to	city	number
			us to

Output 2

Several

bus

can

take

the

city?

N-grams

Several	bus	can	take	us	to	the	city?
	bus		take	us	to	the	city?
			take us		to the
			take us to			the city?
			take us to the
				us to
				us to the
				us to the city?
					to the city?

Output 3

Can

several

number

buses

bring

there

city?

N-grams

Can	several	number	buses	bring	us	to	there	city?
		number			us	to		city?
					us to

Output 4

How

many

number

bus

can

bring

that

city?

N-grams

How	many	number	bus	can	bring	us	to	that	city?
		number	bus			us	to	that	city?
		number bus				us to

Sentence 102) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.5714/0/0/0) ; 0 (0.8333/0/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.8333/0/0/0)

Source

��

��w

�o��

�]�p

�C

Ref 0

don't

the

design.

Ref 1

I'm

not

keen

the

design.

Ref 2

don't

have

any

interest

the

design.

Ref 3

dislike

the

design.

Ref 4

I'm

not

crazy

about

the

design.

Ref 5

The

design

doesn't

much

for

me.

Ref 6

dislike

the

design.

Ref 7

The

design

not

appealing

me.

Ref 8

not

crazy

about

the

design.

Ref 9

The

design

not

style.

Ref 10

I'm

not

keen

the

design.

Ref 11

don't

fancy

the

design.

Ref 12

The

design

doesn't

appeal

me.

Ref 13

The

design

not

taste.

Ref 14

haven't

taken

liking

the

design.

Ref 15

The

design

not

liking.

Output 0

don't

this

design.

N-grams

I	don't	like	this	design.
I	don't	like		design.
I don't
I don't like
	don't like

Output 1

not

this

design

N-grams

i	do	not	like	this	design	.
	do	not	like		design

Output 2

not

this

design.

N-grams

I	do	not	like	this	design.
I	do	not	like		design.

Output 3

don't

this

design.

N-grams

I	don't	like	this	design.
I	don't	like		design.
I don't
I don't like
	don't like

Output 4

not

this

design.

N-grams

I	do	not	like	this	design.
I	do	not	like		design.

Sentence 103) BLEU: 0 (0.08333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.07692/0/0/0) ; 0 (0.2857/0/0/0)

Source

�A��

��

�֢��

�P

��

�H

��

�H

Ref 0

you

have

Hermes'

eau

toilet?

Ref 1

you

have

any

Hermes

eau

toilet?

Ref 2

you

sell

any

Hermes

eau

toilet?

Ref 3

you

carry

any

Hermes

eau

toilet?

Ref 4

you

carry

Hermes'

eau

Toilet?

Ref 5

you

sell

Hermes'

eau

Toilet?

Ref 6

Would

you

have

any

Hermes'

eau

Toilet?

Ref 7

Have

you

Hermes'

eau

toilet?

Ref 8

Would

you

happen

have

Hermes'

eau

toilet?

Ref 9

you

sell

Hermes'

eau

toilet?

Ref 10

you

sell

Hermes'

eau

toilet?

Ref 11

Can

buy

Hermes'

eau

toilet

here?

Ref 12

Have

you

got

Hermes'

eau

toilet

here?

Ref 13

you

carry

Hermes'

eau

toilet?

Ref 14

you

sell

Hermes'

eau

toilet?

Ref 15

Hermes'

eau

toilet

sold

here?

Output 0

You

have

��

the

thin

perfume

the

card

the

��?

N-grams

You	have	��	the	thin	perfume	of	the	card	of	the	��?
	have

Output 1

have

hermes

you

the

perfume

N-grams

have	hermes	you	the	perfume	?
have		you

Output 2

Have

your

Hermes

Eau

license

it?

N-grams

Have	your	Hermes	Eau	license	it?
Have		Hermes

Output 3

You

have

�֢�

the

thin

perfume

the

card

the

��

N-grams

You

have

�֢�

the

thin

perfume

the

card

the

��

have

Output 4

You

have

the

Hermes

sign's

pale

perfume?

N-grams

You	have	the	Hermes	sign's	pale	perfume?
	have		Hermes

Sentence 104) BLEU: 0 (0.5/0.2857/0.1667/0) ; 0 (0.6667/0.375/0.1429/0) ; 0 (0.5/0.2857/0.1667/0) ; 0.6105 (0.7778/0.625/0.5714/0.5) ; 0.6804 (0.75/0.7143/0.6667/0.6)

Source

�o

�a

�u�t

��

�h��

�u�H

�H

Ref 0

How

many

workers

are

employed

this

factory?

Ref 1

How

many

workers

does

this

factory

employ?

Ref 2

How

many

workers

are

this

factory?

Ref 3

How

many

people

are

working

this

factory?

Ref 4

How

many

workers

you

have

this

factory?

Ref 5

How

many

workers

are

there

this

factory?

Ref 6

How

many

workers

work

this

factory?

Ref 7

How

many

workers

does

this

factory

employ?

Ref 8

How

many

workers

are

being

employed

this

factory?

Ref 9

How

many

workers

you

employ

this

factory?

Ref 10

How

many

workers

are

there

this

factory?

Ref 11

How

many

people

work

this

factory?

Ref 12

How

many

factory

employees

are

there

here?

Ref 13

How

many

laborers

are

working

this

factory?

Ref 14

this

factory,

how

many

workers

you

have?

Ref 15

this

factory.

what's

the

number

laborers?

Output 0

The

plant

has

the

number

workers

employed?

N-grams

The	plant	has	the	number	of	workers	employed?
			the	number	of	workers
			the number
			the number of
				number of

Output 1

has

workers

how

many

does

this

factory

hire

N-grams

has	workers	how	many	does	this	factory	hire	?
	workers	how	many	does	this	factory
		how many		does this
				does this factory
					this factory

Output 2

The

plant

has

the

number

workers

employed?

N-grams

The	plant	has	the	number	of	workers	employed?
			the	number	of	workers
			the number
			the number of
				number of

Output 3

How

many

workers

does

this

factory

hire

have?

N-grams

How	many	workers	does	this	factory	hire	to	have?
How	many	workers	does	this	factory			have?
How many		workers does		this factory
How many workers			does this
How many workers does
	many workers		does this factory
	many workers does
	many workers does this
		workers does this
		workers does this factory

Output 4

How

many

workers

does

this

factory

hire

has?

N-grams

How	many	workers	does	this	factory	hire	has?
How	many	workers	does	this	factory
How many		workers does		this factory
How many workers			does this
How many workers does
	many workers		does this factory
	many workers does
	many workers does this
		workers does this
		workers does this factory

Sentence 105) BLEU: 0 (0.4/0.25/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.4/0.25/0/0)

Source

��

�H

Ref 0

Which

way

should

go?

Ref 1

Which

way?

Ref 2

Tell

which

way

go.

Ref 3

Which

way

from

here?

Ref 4

What's

the

right

way

go?

Ref 5

What

direction

should

go?

Ref 6

Which

way

should

head?

Ref 7

which

direction

should

go?

Ref 8

Can

you

tell

which

way

go?

Ref 9

Which

way

you

think

should

go?

Ref 10

Which

way

best?

Ref 11

Which

direction

should

in?

Ref 12

Which

the

best

way?

Ref 13

what

direction

should

in?

Ref 14

What's

the

best

direction

in?

Ref 15

Which

direction

should

in?

Output 0

should

take

that

road?

N-grams

I	should	take	that	road?
I	should
I should

Output 1

should

take

that

road

N-grams

i	should	take	that	road	?
	should

Output 2

should

take

that

road?

N-grams

I	should	take	that	road?
I	should
I should

Output 3

should

walk

that

road?

N-grams

I	should	walk	that	road?
I	should
I should

Output 4

should

take

that

road?

N-grams

I	should	take	that	road?
I	should
I should

Sentence 106) BLEU: 0 (1/1/1/0) ; 0 (0.25/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6667/0.2/0/0)

Source

�

�A

�S��

��

�S�O

��

�C

Ref 0

No,

nothing

particular.

Ref 1

No,

nothing

particular.

Ref 2

No,

nothing

special.

Ref 3

No,

nothing

really.

Ref 4

No,

nothing

special.

Ref 5

No,

there's

nothing

specific.

Ref 6

No,

don't

have

anything

special

mind.

Ref 7

No,

not

anything

particular.

Ref 8

No,

nothing

that

comes

mind.

Ref 9

No,

nothing

major.

Ref 10

It's

fine,

nothing

special.

Ref 11

No,

there's

nothing

particular.

Ref 12

It's

okay,

nothing

specific.

Ref 13

No,

nothing

special.

Ref 14

No,

not

anything

special.

Ref 15

No,

not

anything

particular.

Output 0

No,

nothing

special.

N-grams

No,	nothing	special.
No,	nothing	special.
No, nothing
No, nothing special.
	nothing special.

Output 1

special

N-grams

no	,	special	.
		special

Output 2

No,

Nothing

special.

N-grams

No,	Nothing	special.
No,		special.

Output 3

Don't

isn't

special.

N-grams

Don't	isn't	special.
		special.

Output 4

No,

does

not

have

anything

specially.

N-grams

No,	does	not	have	anything	specially.
No,		not	have	anything
			have anything

Sentence 107) BLEU: 1 (1/1/1/1) ; 0 (0.3333/0/0/0) ; 1 (1/1/1/1) ; 0 (1/0.6667/0.5/0) ; 0 (0.6667/0.6/0.25/0)

Source

��

�ݭn

�w��

��

�H

Ref 0

need

reservation?

Ref 1

reservation

needed?

Ref 2

reservation

necessary?

Ref 3

have

make

reservation?

Ref 4

Are

reservations

necessary?

Ref 5

have

reservation?

Ref 6

Would

need

reservation?

Ref 7

necessary

have

reservations?

Ref 8

Must

have

reservations?

Ref 9

you

require

reservations?

Ref 10

Must

make

reservation?

Ref 11

reservation

necessary?

Ref 12

necessary

make

reservation?

Ref 13

reservation

required?

Ref 14

you

require

reservation?

Ref 15

need

reserve?

Output 0

need

reservation?

N-grams

I	need	a	reservation?
I	need	a	reservation?
I need		a reservation?
I need a
I need a reservation?
	need a
	need a reservation?

Output 1

need

N-grams

i	need	?
	need

Output 2

need

reservation?

N-grams

I	need	a	reservation?
I	need	a	reservation?
I need		a reservation?
I need a
I need a reservation?
	need a
	need a reservation?

Output 3

need

reserve?

N-grams

Do	I	need	reserve?
Do	I	need	reserve?
Do I
Do I need
	I need

Output 4

need

make

appointment?

N-grams

I	need	to	make	an	appointment?
I	need	to	make
I need		to make
I need to
	need to

Sentence 108) BLEU: 0 (0.8/0.25/0/0) ; 0 (0.6/0/0/0) ; 1 (1/1/1/1) ; 0 (0.6/0/0/0) ; 0 (0.8/0.25/0/0)

Source

��

�M�~

�O

�k��

�C

Ref 0

major

was

law.

Ref 1

majored

law.

Ref 2

Law

was

major.

Ref 3

was

law

major.

Ref 4

majored

law.

Ref 5

took

law

major.

Ref 6

had

major

law.

Ref 7

majored

law.

Ref 8

Law

was

major.

Ref 9

major

was

law.

Ref 10

majored

law.

Ref 11

specialized

law.

Ref 12

specialty

was

law.

Ref 13

majored

law.

Ref 14

field

study

was

law.

Ref 15

studied

law.

Output 0

specialty

law.

N-grams

My	specialty	is	a	law.
My	specialty		a	law.
My specialty

Output 1

law

N-grams

law	my	is	a	.
law	my		a

Output 2

majored

law.

N-grams

I	majored	in	law.
I	majored	in	law.
I majored		in law.
I majored in
I majored in law.
	majored in
	majored in law.

Output 3

profession

law.

N-grams

My	profession	is	a	law.
My			a	law.

Output 4

specialty

law.

N-grams

My	specialty	is	a	law.
My	specialty		a	law.
My specialty

Sentence 109) BLEU: 0 (0.6429/0.1538/0.08333/0) ; 0 (0.6/0.1111/0/0) ; 0 (0.6429/0.1538/0.08333/0) ; 0 (0.6364/0.2/0/0) ; 0 (0.7273/0.1/0/0)

Source

��

��f

��

�o

��

�O

��

�C

Ref 0

light

was

green

when

got

the

intersection.

Ref 1

The

light

was

green

when

entered

the

intersection.

Ref 2

When

entered

the

intersection

the

light

was

green.

Ref 3

The

light

hadn't

turned

when

entered

the

intersection.

Ref 4

light

was

green

when

entered

the

intersection.

Ref 5

When

went

into

the

intersection,

had

green

light.

Ref 6

When

entered

the

intersection,

had

the

green

light.

Ref 7

The

light

was

green

when

entered

the

intersection.

Ref 8

When

approached

the

intersection,

light

was

green.

Ref 9

When

went

through

the

intersection,

the

light

was

green.

Ref 10

passed

green

light

the

intersection.

Ref 11

When

got

the

intersection

the

light

was

green.

Ref 12

The

light

was

green

got

the

intersection.

Ref 13

The

traffic

light

was

green

for

when

entered

the

intersection.

Ref 14

The

traffic

light

was

green

when

went

into

the

intersection.

Ref 15

the

moment

entered

into

the

intersection,

the

light

was

green.

Output 0

When

went

side

the

Junction

when

the

lights

are

green.

N-grams

When

went

side

the

Junction

when

the

lights

are

green.

When

went

the

when

the

green.

When I

When I went

I went

Output 1

when

the

green

street

N-grams

when	i	to	my	the	the	green	street	is	.
when		to	my	the	the	green
					the green

Output 2

When

went

side

the

junction

when

the

lights

are

green.

N-grams

When

went

side

the

junction

when

the

lights

are

green.

When

went

the

when

the

green.

When I

When I went

I went

Output 3

When

street

corner

light

green.

N-grams

When	I	go	to	a	street	corner	my	light	is	green.
When	I		to	a			my	light		green.
When I							my light

Output 4

When

street

intersection

the

lamp

the

green.

N-grams

When	I	to	street	intersection	me	the	lamp	is	the	green.
When	I	to		intersection	me	the			the	green.
When I

Sentence 110) BLEU: 0.5373 (0.7/0.5556/0.5/0.4286) ; 0 (0.625/0.1429/0/0) ; 0.4347 (0.7143/0.5/0.4/0.25) ; 0.5373 (0.7/0.5556/0.5/0.4286) ; 0 (0.8571/0.3333/0/0)

Source

�ж�

�A�ȳ�

�C

��

��U

�A

��

�H

Ref 0

Room

service.

Can

help

you?

Ref 1

This

room

service.

Can

anything

for

you?

Ref 2

Room

service.

Can

get

you

anything?

Ref 3

Room

service.

What

can

for

you?

Ref 4

This

room

service.

What

can

for

you?

Ref 5

Room

service.

How

can

help

you?

Ref 6

Room

service.

What

would

you

like?

Ref 7

This

room

service.

May

assistance?

Ref 8

Room

service.

What

can

for

you?

Ref 9

You've

reached

room

service.

May

help

you?

Ref 10

Room

service

speaking.

How

can

help

you?

Ref 11

Room

service

here.

What

can

for

you?

Ref 12

This

room

service.

How

can

service?

Ref 13

This

room

service.

What

can

for

you?

Ref 14

Room

service.

What

may

help

you

with?

Ref 15

Room

service.

May

assistance?

Output 0

The

department

the

room

service.

Can

help

you?

N-grams

The	department	of	the	room	service.	Can	I	help	you?
		of		room	service.	Can	I	help	you?
				room service.		Can I		help you?
				room service. Can			I help
				room service. Can I
					service. Can		I help you?
					service. Can I
					service. Can I help
						Can I help
						Can I help you?

Output 1

room

service

department

can

help

you

N-grams

room	service	department	can	i	help	you	?
room	service		can		help	you
					help you

Output 2

Room

Service

Department.

Can

help

you?

N-grams

Room	Service	Department.	Can	I	help	you?
Room			Can	I	help	you?
			Can I		help you?
			Can I help
			Can I help you?
				I help
				I help you?

Output 3

The

department

the

room

service.

Can

help

you?

N-grams

The	department	of	the	room	service.	Can	I	help	you?
		of		room	service.	Can	I	help	you?
				room service.		Can I		help you?
				room service. Can			I help
				room service. Can I
					service. Can		I help you?
					service. Can I
					service. Can I help
						Can I help
						Can I help you?

Output 4

Room

service

department.

can

help

you?

N-grams

Room	service	department.	I	can	help	you?
Room	service		I	can	help	you?
Room service					help you?

Sentence 111) BLEU: 0.4273 (0.875/0.5714/0.3333/0.2) ; 0 (0.6667/0.2/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0.4273 (0.875/0.5714/0.3333/0.2) ; 0.4889 (0.8571/0.6667/0.4/0.25)

Source

��

�ݭn

�w��

�I�O

��

�H

Ref 0

need

pay

advance?

Ref 1

need

pay

beforehand?

Ref 2

need

pay

up-front?

Ref 3

there

up-front

fee?

Ref 4

prepay

system?

Ref 5

you

need

the

money

advance?

Ref 6

pay

first?

Ref 7

Must

pay

advance?

Ref 8

you

require

payment

advance?

Ref 9

Will

necessary

for

pay

advance?

Ref 10

this

advance

payment

system?

Ref 11

necessary

pay

advance?

Ref 12

Should

pay

advance?

Ref 13

pay

beforehand?

Ref 14

advance

payment?

Ref 15

have

pay

advance?

Output 0

need

paid

advance?

N-grams

Do	I	need	to	be	paid	in	advance?
Do	I	need	to	be		in	advance?
Do I		need to				in advance?
Do I need
Do I need to
	I need
	I need to

Output 1

need

advance

N-grams

i	need	to	in	advance	?
	need	to	in	advance
	need to

Output 2

need

pre-pay?

N-grams

I	need	to	pre-pay?
I	need	to
I need
I need to
	need to

Output 3

need

paid

advance?

N-grams

Do	I	need	to	be	paid	in	advance?
Do	I	need	to	be		in	advance?
Do I		need to				in advance?
Do I need
Do I need to
	I need
	I need to

Output 4

need

pay

expenses

advance?

N-grams

I	need	to	pay	expenses	in	advance?
I	need	to	pay		in	advance?
I need		to pay			in advance?
I need to
I need to pay
	need to
	need to pay

Sentence 112) BLEU: 0.5774 (1/0.7778/0.5/0.2857) ; 0 (0.4667/0/0/0) ; 0.5774 (1/0.7778/0.5/0.2857) ; 0 (0.6154/0.1667/0/0) ; 0 (0.9091/0.6/0.1111/0)

Source

�

�A

�p�G

�i��

��

�A

��

�Q

�b

��I��

�n

��

�C

Ref 0

No,

I'd

two

o'clock,

possible.

Ref 1

No,

I'd

two

o'clock,

possible.

Ref 2

No,

possible

I'd

two

o'clock.

Ref 3

No,

two

o'clock,

that's

alright.

Ref 4

No,

you

can,

please

make

two

o'clock.

Ref 5

No,

all

possible,

I'd

prefer

two

o'clock.

Ref 6

No,

possible,

I'd

want

two

o'clock.

Ref 7

No,

possible,

two

o'clock

would

better.

Ref 8

Not

really,

two

o'clock

would

preferable.

Ref 9

don't

think

so,

you

can,

two

o'clock

would

better.

Ref 10

No,

want

two

o'clock,

that's

possible.

Ref 11

No,

two

o'clock

would

best

for

me,

you

can

make

it.

Ref 12

No,

please

could

have

two

o'clock?

Ref 13

Nope,

you

can,

would

for

two

o'clock.

Ref 14

Nope,

it's

possible,

would

request

for

two

o'clock.

Ref 15

Nope,

you

can,

request

two

o'clock.

Output 0

No,

possible,

would

two

o'clock.

N-grams

No,	if	possible,	I	would	like	it	to	two	o'clock.
No,	if	possible,	I	would	like	it	to	two	o'clock.
No, if		possible, I		would like				two o'clock.
No, if possible,			I would		like it
	if possible,		I would like
		possible, I would
		possible, I would like
			I would like it
				would like it

Output 1

possible

two

'clock

want

N-grams

possible

two

'clock

want

possible

two

want

Output 2

No,

possible,

would

two

o'clock.

N-grams

No,	if	possible,	I	would	like	it	to	two	o'clock.
No,	if	possible,	I	would	like	it	to	two	o'clock.
No, if		possible, I		would like				two o'clock.
No, if possible,			I would		like it
	if possible,		I would like
		possible, I would
		possible, I would like
			I would like it
				would like it

Output 3

Not,

possible

words,

want

two

o'clocks.

N-grams

Not,

possible

words,

want

two

o'clocks.

possible

want

want it

two

I want

Output 4

No,

possible,

want

two

o'clock.

N-grams

No,	if	possible,	I	want	to	want	it	in	two	o'clock.
No,	if	possible,	I	want	to	want it			two	o'clock.
No, if		possible, I					it		two o'clock.
No, if possible,			I want
	if possible,

Sentence 113) BLEU: 0 (0.625/0.1429/0/0) ; 0 (0.625/0.2857/0/0) ; 0 (0.625/0.1429/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.4/0/0/0)

Source

��

�ǳ�

�n

�F

�ڭ�

�

��q��

��

�A

�C

Ref 0

We'll

call

your

number

when

it's

ready.

Ref 1

We'll

call

your

number

when

it's

done.

Ref 2

Your

number

will

called

when

it's

ready.

Ref 3

You'll

have

your

number

called

when

it's

ready.

Ref 4

We'll

call

out

your

number

when

it's

up.

Ref 5

We'll

say

your

number

when

the

food's

ready.

Ref 6

We'll

give

your

number

shout

when

it's

ready.

Ref 7

Your

number

will

called

when

it's

ready.

Ref 8

When

it's

ready,

your

number

will

called.

Ref 9

You'll

hear

your

number

being

called

when

it's

ready.

Ref 10

When

it's

finished

we'll

call

out

your

number.

Ref 11

We'll

call

you

your

number

once

it's

done.

Ref 12

Your

number

will

called

when

it's

done.

Ref 13

We'll

call

you

when

it's

finished.

Ref 14

We'll

call

you

when

it's

done.

Ref 15

We'll

give

you

call

when

ready.

Output 0

When

ready

will

call

you.

N-grams

When	it	is	ready	we	will	call	you.
When	it	is			will	call
	it is

Output 1

when

will

call

you

N-grams

when	it	will	call	you	to	us	.
when	it	will	call	you
when it			call you

Output 2

When

ready

will

call

you.

N-grams

When	it	is	ready	we	will	call	you.
When	it	is			will	call
	it is

Output 3

When

its

preparing

will

call

you.

N-grams

When	its	preparing	to	like	us	will	call	you.
When						will	call

Output 4

When

will

prepare

telephone

give

you.

N-grams

When	it	will	prepare	us	to	telephone	to	give	you.
When	it	will						give

Sentence 114) BLEU: 0 (0.5/0.4/0.25/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.5/0.4/0.25/0) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.4/0.25/0/0)

Source

�藍�_

�C

��

�L

�@�U

�C

Ref 0

Excuse

me.

Let

pass,

please.

Ref 1

Excuse

me,

please

let

by.

Ref 2

Please

let

by.

Ref 3

Excuse

me,

coming

through.

Ref 4

Pardon

me.

Could

get

by?

Ref 5

Sorry.

May

get

through?

Ref 6

Excuse

me.

Coming

through,

thanks.

Ref 7

Pardon

me,

but

can

get

through?

Ref 8

Sorry,

but

could

you

let

through

please?

Ref 9

Excuse

me,

but

I'd

get

through.

Ref 10

Sorry.

May

pass?

Ref 11

Sorry

bother

you.

Could

get

past?

Ref 12

apologize.

Could

you

let

pass?

Ref 13

Excuse

me.

Please

let

by.

Ref 14

Excuse

me.

Please

let

through.

Ref 15

Excuse

me.

Please

allow

passage.

Output 0

�\x8D�\x8D�\xB7.

Please

let

have

some.

N-grams

�\x8D�\x8D�\xB7.	Please	let	me	have	some.
	Please	let	me
	Please let
	Please let me
		let me

Output 1

please

let

N-grams

please	let	me	.
please	let	me
please let
please let me
	let me

Output 2

不起.

Please

let

have

some.

N-grams

不起.	Please	let	me	have	some.
	Please	let	me
	Please let
	Please let me
		let me

Output 3

Sorry.

Please

let

lead

while.

N-grams

Sorry.	Please	let	me	lead	a	while.
Sorry.	Please	let	me
	Please let
	Please let me
		let me

Output 4

Being

unfair.

Please

let

my.

N-grams

Being	unfair.	Please	let	my.
		Please	let
		Please let

Sentence 115) BLEU: 0 (0.7273/0.5/0.1111/0) ; 0 (0.7143/0/0/0) ; 0 (0.7273/0.5/0.1111/0) ; 0 (0.4615/0/0/0) ; 0 (0.4545/0/0/0)

Source

��

�O

�@

��

�M��

�w��

�M

��A

��

�n

�h�B

�C

Ref 0

It's

great

place

for

peace

and

quiet.

Ref 1

It's

great

place

recuperate.

Ref 2

It's

nice

place

and

have

some

peace

and

quiet.

Ref 3

It's

good

place

and

get

some

peace

and

quiet.

Ref 4

It's

fabulous

place

for

rest

and

relaxation.

Ref 5

It's

super

place

for

little

and

Ref 6

It's

wonderful

place

get

away

from

all.

Ref 7

It's

the

perfect

place

for

quiet

relaxation.

Ref 8

For

quiet

and

relaxation,

it's

the

place

go.

Ref 9

What

great

place

for

quiet

and

relaxation.

Ref 10

This

brilliant

place

for

getting

some

rest.

Ref 11

you

are

looking

for

peace

and

quiet,

this

the

right

place

for

you.

Ref 12

This

wonderful

place

for

people

seeking

peach

and

quiet.

Ref 13

It's

great

place

for

quiet

rest.

Ref 14

It's

great

place

quietly

relax.

Ref 15

It's

wonderful

place

for

tranquil

rest.

Output 0

peace

and

find

good

place

for

leisure.

N-grams

It	is	a	peace	and	find	a	good	place	for	leisure.
	is	a	peace	and		a	good	place	for
	is a		peace and			a good		place for
						a good place
							good place

Output 1

and

good

for

one

N-grams

it	is	and	good	for	one	.
it	is	and	good	for

Output 2

peace

and

find

good

place

for

leisure.

N-grams

It	is	a	peace	and	find	a	good	place	for	leisure.
	is	a	peace	and		a	good	place	for
	is a		peace and			a good		place for
						a good place
							good place

Output 3

one

look

for

hospice

and

leisurely

and

contented

good

whereabouts.

N-grams

one

look

for

hospice

and

leisurely

and

contented

good

whereabouts.

for

and

good

Output 4

one

seeks

for

peaceful

and

the

comfortable

good

destination.

N-grams

It	is	one	seeks	for	peaceful	and	the	comfortable	good	destination.
	is			for		and	the		good

Sentence 116) BLEU: 0.6985 (0.8889/0.75/0.7143/0.5) ; 0 (0.2857/0/0/0) ; 0.6985 (0.8889/0.75/0.7143/0.5) ; 0 (0.625/0.4286/0.1667/0) ; 0 (0.6667/0.2/0/0)

Source

�

�A

��

�A

�C

��

�i�H

�ۤv

�B�z

�C

Ref 0

No,

thank

you.

can

manage

own.

Ref 1

No,

thanks.

I've

got

it.

Ref 2

No,

thanks.

can

handle

it.

Ref 3

No,

thanks.

can

own.

Ref 4

No,

it's

OK,

thanks.

can

take

care

myself.

Ref 5

No,

but

thanks

all

the

same.

can

handle

myself.

Ref 6

No,

but

thanks

anyway.

can

deal

with

myself.

Ref 7

No,

that's

okay.

I'll

figure

out

myself.

Ref 8

No,

thanks.

think

can

figure

out

own.

Ref 9

That's

alright.

I'll

manage

somehow

myself.

Ref 10

Thanks,

but

can

make

own.

Ref 11

It's

okay.

can

myself.

Ref 12

It's

fine.

I'll

able

manage

alone.

Ref 13

No,

thank

you.

can

myself.

Ref 14

No,

thank

you.

can

own.

Ref 15

No,

thank

you.

alright

myself.

Output 0

No,

thank

you.

can

deal

with

their

own.

N-grams

No,	thank	you.	I	can	deal	with	their	own.
No,	thank	you.	I	can	deal	with		own.
No, thank		you. I		can deal
No, thank you.			I can		deal with
No, thank you. I				can deal with
	thank you.		I can deal
	thank you. I
	thank you. I can
		you. I can
			I can deal with

Output 1

thank

you

can

N-grams

no	,	thank	you	i	can	.
		thank			can

Output 2

No,

thank

you.

can

deal

with

their

own.

N-grams

No,	thank	you.	I	can	deal	with	their	own.
No,	thank	you.	I	can	deal	with		own.
No, thank		you. I		can deal
No, thank you.			I can		deal with
No, thank you. I				can deal with
	thank you.		I can deal
	thank you. I
	thank you. I can
		you. I can
			I can deal with

Output 3

Thank

you

not.

can

handle

myself.

N-grams

Thank	you	not.	I	can	handle	by	myself.
			I	can	handle	by	myself.
			I can			by myself.
			I can handle
				can handle

Output 4

No,

thanks

you.

may

process.

N-grams

No,	thanks	you.	I	may	process.
No,	thanks	you.	I
		you. I

Sentence 117) BLEU: 0.3217 (0.8125/0.4/0.2143/0.1538) ; 0.317 (0.9091/0.4/0.2222/0.125) ; 0.4367 (0.75/0.5455/0.4/0.2222) ; 0 (0.9091/0.2/0/0) ; 0.3217 (0.8125/0.4/0.2143/0.1538)

Source

��

�L�k

�X�u

�۫ݷ

��

�

�e

§��

��

��P

�q��

�C

Ref 0

Those

who

cannot

attend

the

reception

will

send

present

congratulatory

telegram.

Ref 1

People

who

cannot

come

the

reception

will

send

present

congratulatory

telegram.

Ref 2

You'll

get

present

congratulatory

from

those

who

cannot

attend

the

reception.

Ref 3

People

will

send

presents

congratulatory

telegrams

they

cannot

attend

the

reception.

Ref 4

Those

who

will

not

present

the

reception

will

sending

gift

congratulations.

Ref 5

The

ones

who

cannot

the

banquet

will

send

gifts

congratulatory

telegrams.

Ref 6

People

who

are

unable

the

reception

are

going

send

gifts

congratulations

telegrams.

Ref 7

gift

congratulatory

will

sent

those

who

are

unable

attend

the

reception.

Ref 8

people

are

unable

attend

the

reception,

they

will

most

likely

send

present

congratulatory

telegram.

Ref 9

Those

unable

attend

the

reception

are

planning

send

present

congratulatory

telegram.

Ref 10

For

those

who

cannot

come

the

reception,

they

will

send

present

congratulatory

telegram.

Ref 11

People

who

can't

make

the

reception

will

send

present

congratulatory

telegram.

Ref 12

you

can't

make

the

reception,

you

can

send

present

congratulatory

telegram.

Ref 13

Those

who

are

unable

attend

the

reception,

please

send

gift

telegram.

Ref 14

From

those

who

cannot

attend

reception,

will

expecting

gift.

Ref 15

Those

absent

from

the

reception

will

send

along

congratulatory

gift

telegram.

Output 0

These

will

unable

attend

the

reception

deliver

the

gift

the

congratulation

telegram.

N-grams

These

will

unable

attend

the

reception

deliver

the

gift

the

congratulation

telegram.

will

unable

attend

the

reception

gift

telegram.

will be

unable to

attend the

gift or

unable to attend

the reception

unable to attend the

to attend

to attend the

to attend the reception

attend the reception

Output 1

those

unable

attend

the

will

reception

gift

N-grams

those	unable	to	attend	the	will	or	telegram	reception	gift	.
those	unable	to	attend	the	will	or	telegram	reception	gift
	unable to		attend the			or telegram
	unable to attend
	unable to attend the
		to attend
		to attend the

Output 2

Those

unable

attend

the

conference

will

give

gifts

congratulations

Telegram.

N-grams

Those	unable	to	attend	the	conference	will	give	gifts	or	congratulations	Telegram.
Those	unable	to	attend	the		will		gifts	or	congratulations
Those unable		to attend						gifts or
Those unable to			attend the					gifts or congratulations
Those unable to attend									or congratulations
	unable to
	unable to attend
	unable to attend the
		to attend the

Output 3

Those

can't

attend

reception

will

send

gift

congratulate

telegram.

N-grams

Those	can't	attend	reception	of	will	send	gift	or	congratulate	telegram.
Those	can't	attend	reception	of	will	send	gift	or		telegram.
					will send		gift or

Output 4

These

will

unable

attend

the

reception

deliver

the

gift

the

congratulation

telegram.

N-grams

These

will

unable

attend

the

reception

deliver

the

gift

the

congratulation

telegram.

will

unable

attend

the

reception

gift

telegram.

will be

unable to

attend the

gift or

unable to attend

the reception

unable to attend the

to attend

to attend the

to attend the reception

attend the reception

Sentence 118) BLEU: 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0)

Source

��

�C

Ref 0

Thanks.

Ref 1

Thank

you.

Ref 2

Thanks

lot.

Ref 3

Thank

you.

Ref 4

Thanks

much.

Ref 5

Thank

you.

Ref 6

Thanks

lot.

Ref 7

Thanks

very

much.

Ref 8

Many

thanks.

Ref 9

appreciate

it.

Ref 10

Thank

you.

Ref 11

Thank

you.

Ref 12

Obliged.

Ref 13

grateful.

Ref 14

Thanks.

Ref 15

Thanks.

Output 0

Thanks.

N-grams

Thanks.

Output 1

N-grams

Output 2

謝謝.

N-grams

謝謝.

Output 3

Thank.

N-grams

Thank.

Output 4

Thanks.

N-grams

Thanks.

Sentence 119) BLEU: 0 (0.5/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6667/0/0/0)

Source

��

�D�`

�n

�C

Ref 0

I'm

not

bad

all.

Ref 1

I'm

pretty

good.

Ref 2

I'm

not

too

bad.

Ref 3

I'm

better

than

average.

Ref 4

I'm

fairly

good

it.

Ref 5

I'm

pretty

good.

Ref 6

I'm

not

half

bad

it.

Ref 7

I'm

pretty

good.

Ref 8

can

play

quite

well.

Ref 9

I'm

better

than

average.

Ref 10

I'm

not

that

bad.

Ref 11

I'm

quite

good.

Ref 12

can

pretty

well.

Ref 13

I'm

not

too

bad.

Ref 14

I'm

not

all

too

bad

it.

Ref 15

I'm

okay

it.

Output 0

was

very

good.

N-grams

I	was	very	good.
I			good.

Output 1

very

good

N-grams

i	very	good	am	.
		good

Output 2

was

very

good.

N-grams

I	was	very	good.
I			good.

Output 3

very

good.

N-grams

I	am	very	good.
I			good.

Output 4

good.

N-grams

I	am	good.
I		good.

Sentence 120) BLEU: 0 (0.75/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0)

Source

��t

��

�ɭ�

��

�H

Ref 0

What

time

does

the

performance

end?

Ref 1

What

time

will

the

performance

end?

Ref 2

The

end

the

performance

what

time?

Ref 3

What

time

with

the

end

the

performance

be?

Ref 4

When

will

the

performance

ending?

Ref 5

What

time

the

performance

over?

Ref 6

What

time

will

the

performance

finish?

Ref 7

What

time

the

end

the

show?

Ref 8

When

will

the

show

end?

Ref 9

Until

what

time

the

show?

Ref 10

What's

the

finishing

time

the

performance?

Ref 11

When

does

the

performance

end?

Ref 12

When

will

the

performance

over?

Ref 13

what

time

does

the

performance

conclude?

Ref 14

When

does

the

performance

end?

Ref 15

When

does

the

performance

finish?

Output 0

When

performing

the

end?

N-grams

When	performing	the	end?
When		the	end?

Output 1

when

end

N-grams

when	end	?
	end

Output 2

When

performing

The

End?

N-grams

When	performing	The	End?
When		The

Output 3

Perform

when

end?

N-grams

Perform	when	end?
		end?

Output 4

When

performed

finished?

N-grams

When	performed	finished?
When

Sentence 121) BLEU: 1 (1/1/1/1) ; 0 (0.6667/0.4/0.25/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0.6687 (0.875/0.8571/0.6667/0.4)

Source

�ڭ�

�Q

��

�b

�@�_

�C

Ref 0

would

sit

together.

Ref 1

want

sit

together.

Ref 2

Please

seat

together.

Ref 3

want

sit

one

another.

Ref 4

want

sit

together.

Ref 5

We'd

seated

together.

Ref 6

want

sit

each

other.

Ref 7

Could

sit

together?

Ref 8

want

seated

together.

Ref 9

We're

hoping

get

seated

together.

Ref 10

want

sit

each

other.

Ref 11

We'd

have

seats

each

other.

Ref 12

Can

sit

the

same

place?

Ref 13

would

sit

each

other.

Ref 14

would

seated

together.

Ref 15

want

sit

together.

Output 0

want

sit

together.

N-grams

We	want	to	sit	together.
We	want	to	sit	together.
We want		to sit
We want to			sit together.
We want to sit
	want to
	want to sit
	want to sit together.
		to sit together.

Output 1

want

sit

together

N-grams

we	want	to	sit	together	.
we	want	to	sit
	want to
	want to sit
		to sit

Output 2

want

sit

together.

N-grams

We	want	to	sit	together.
We	want	to	sit	together.
We want		to sit
We want to			sit together.
We want to sit
	want to
	want to sit
	want to sit together.
		to sit together.

Output 3

want

sit

together.

N-grams

We	want	to	sit	together.
We	want	to	sit	together.
We want		to sit
We want to			sit together.
We want to sit
	want to
	want to sit
	want to sit together.
		to sit together.

Output 4

want

sit

the

same

place.

N-grams

We	want	to	sit	in	the	same	place.
We	want	to	sit	in	the	same
We want		to sit		in the
We want to			sit in		the same
We want to sit				in the same
	want to		sit in the
	want to sit
			sit in the same

Sentence 122) BLEU: 0 (1/0.6667/0.5/0) ; 0 (0.5/0.2/0/0) ; 0 (1/0.6667/0.5/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.8/0.5/0.3333/0)

Source

��

�Q

�n

�@

��

��~

�C

Ref 0

I'd

nursing

bottle.

Ref 1

want

nursing

bottle.

Ref 2

Could

have

nursing

bottle?

Ref 3

nursing

bottle

what

would

like.

Ref 4

I'd

bottle

for

feeding

baby.

Ref 5

need

baby

bottle.

Ref 6

I'd

have

baby

bottle.

Ref 7

I'm

looking

for

baby

bottle.

Ref 8

want

get

nursing

bottle.

Ref 9

I'd

get

nursing

bottle.

Ref 10

you

sell

nursing

bottles?

Ref 11

Could

please

have

nursing

bottle?

Ref 12

want

buy

nursing

bottle.

Ref 13

would

buy

baby

bottle.

Ref 14

looking

for

baby

bottle.

Ref 15

would

baby

bottle.

Output 0

I'd

bottle.

N-grams

I'd	like	a	bottle.
I'd	like	a	bottle.
I'd like
I'd like a
	like a

Output 1

bottle

want

milk

N-grams

i	a	bottle	want	milk	.
	a	bottle	want
	a bottle

Output 2

I'd

bottle.

N-grams

I'd	like	a	bottle.
I'd	like	a	bottle.
I'd like
I'd like a
	like a

Output 3

want

milk

bottle.

N-grams

I	want	a	milk	bottle.
I	want	a		bottle.
I want
I want a
	want a

Output 4

want

milk

bottle.

N-grams

I	want	a	milk	bottle.
I	want	a		bottle.
I want
I want a
	want a

Sentence 123) BLEU: 0 (0.5/0.1429/0/0) ; 0 (0.75/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0.1429/0/0) ; 0 (0.2/0/0/0)

Source

��

��ĵ

�q��

�C

Ref 0

Call

the

police.

Ref 1

Get

the

police.

Ref 2

Get

the

police.

Ref 3

Contact

the

police.

Ref 4

Alert

the

police.

Ref 5

Could

you

call

the

police,

please?

Ref 6

Get

the

police.

Ref 7

Contact

the

police.

Ref 8

Get

the

police.

Ref 9

Ask

the

police

come.

Ref 10

Please

call

the

police.

Ref 11

Get

the

police.

Ref 12

Ring

the

police.

Ref 13

Contact

the

police.

Ref 14

Call

the

police.

Ref 15

Call

the

police.

Output 0

Beat

report

the

police

telephone.

N-grams

Beat	to	report	to	the	police	a	telephone.
	to			the	police
				the police

Output 1

call

the

N-grams

call	to	the	.
call	to	the

Output 2

Alarm

call

fight.

N-grams

Alarm	call	to	fight.
	call	to

Output 3

Beat

report

the

police

telephone.

N-grams

Beat	to	report	to	the	police	a	telephone.
	to			the	police
				the police

Output 4

Makes

the

warning

phone

call.

N-grams

Makes	the	warning	phone	call.
	the

Sentence 124) BLEU: 1 (1/1/1/1) ; 0 (0.5/0/0/0) ; 1 (1/1/1/1) ; 0 (0.6667/0.4/0/0) ; 0 (0.75/0.6667/0.5/0)

Source

��

�y��

�@�U

�C

Ref 0

Just

moment,

please.

Ref 1

Wait

moment,

please.

Ref 2

Please

wait

moment.

Ref 3

Please

wait

moment.

Ref 4

Please

wait

just

minute.

Ref 5

Wait

second,

please.

Ref 6

Hold

just

minute,

please.

Ref 7

One

moment,

please.

Ref 8

Could

you

hang

for

second,

please?

Ref 9

Hold

for

moment,

please.

Ref 10

Could

you

hold

second?

Ref 11

Kindly

wait

minute.

Ref 12

Please

wait

moment.

Ref 13

Please

wait

little,

please.

Ref 14

Please

wait

moment,

please.

Ref 15

Please

wait

for

just

one

moment,

please.

Output 0

Just

moment,

please.

N-grams

Just	a	moment,	please.
Just	a	moment,	please.
Just a		moment, please.
Just a moment,
Just a moment, please.
	a moment,
	a moment, please.

Output 1

please

wait

N-grams

a	please	wait	.
a		wait

Output 2

Just

moment,

please.

N-grams

Just	a	moment,	please.
Just	a	moment,	please.
Just a		moment, please.
Just a moment,
Just a moment, please.
	a moment,
	a moment, please.

Output 3

Please

slightly

wait

for

while.

N-grams

Please	slightly	wait	for	a	while.
Please		wait	for	a
		wait for
			for a

Output 4

Please

wait

bit.

N-grams

Please	wait	a	bit.
Please	wait	a
Please wait
Please wait a
	wait a

Sentence 125) BLEU: 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.6/0.5/0.3333/0) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (1/1/1/0) ; 0 (1/1/1/0)

Source

�ڭ�

��

�ɭ�

��

�H

Ref 0

What

time

shall

come?

Ref 1

What

time

should

come?

Ref 2

What

would

good

time

for

come?

Ref 3

what

time

would

you

come?

Ref 4

What

time

you

want

come?

Ref 5

What

time

should

get

there?

Ref 6

What

time

would

you

there?

Ref 7

What

time

should

visit?

Ref 8

When

should

come

over?

Ref 9

What's

the

best

time

for

come

over?

Ref 10

What

time

shall

there?

Ref 11

When

you

want

come

round?

Ref 12

When

would

you

visit?

Ref 13

What

time

good

time

come?

Ref 14

What

time

good

visit?

Ref 15

what

time

best

come?

Output 0

When

should

come

from?

N-grams

When	should	we	come	from?
When	should	we	come
When should		we come
When should we
When should we come
	should we
	should we come

Output 1

when

should

come

N-grams

when	should	we	come	?
	should	we	come
	should we
	should we come
		we come

Output 2

When

should

come

from?

N-grams

When	should	we	come	from?
When	should	we	come
When should		we come
When should we
When should we come
	should we
	should we come

Output 3

When

should

come?

N-grams

When	should	we	come?
When	should	we	come?
When should		we come?
When should we
	should we
	should we come?

Output 4

When

should

come?

N-grams

When	should	we	come?
When	should	we	come?
When should		we come?
When should we
	should we
	should we come?

Sentence 126) BLEU: 0 (0.2727/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2727/0/0/0) ; 0 (0.1667/0/0/0)

Source

��

�i�H

��

�A��

��

�H

Ref 0

room

service

still

available?

Ref 1

there

still

room

service

available?

Ref 2

Can

still

use

room

service?

Ref 3

Can

still

have

room

service

bring

something?

Ref 4

you

still

have

room

service?

Ref 5

Can

still

get

room

service?

Ref 6

room

service

still

on?

Ref 7

Are

you

still

offering

room

service?

Ref 8

Can

still

get

room

service?

Ref 9

room

service

still

being

offered?

Ref 10

Can

still

call

room

service?

Ref 11

still

time

order

room

service?

Ref 12

there

still

room

service?

Ref 13

you

still

have

room

service?

Ref 14

May

still

use

room

service?

Ref 15

May

still

order

something

from

room

service?

Output 0

all

right

also

provide

serve

house?

N-grams

Is	it	all	right	to	also	provide	to	serve	a	house?
Is				to

Output 1

also

provide

the

N-grams

also	to	provide	to	the	it	?
	to

Output 2

Also

able

provide

services

the

housing

estates

it?

N-grams

Also	be	able	to	provide	services	to	the	housing	estates	to	it?
			to

Output 3

all

right

also

provide

serve

house?

N-grams

Is	it	all	right	to	also	provide	to	serve	a	house?
Is				to

Output 4

May

also

provide

serves

the

room?

N-grams

May	also	provide	serves	the	room?
May

Sentence 127) BLEU: 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0.2222/0/0) ; 0 (0.375/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�U

�@

�K�h

�N

��

�F

�@

�K�h

�C

Ref 0

penny

saved

penny

earned.

Ref 1

Saving

penny

the

same

earning

penny.

Ref 2

Saving

penny

good

making

penny.

Ref 3

you

save

penny,

just

making

penny.

Ref 4

Save

penny,

earn

penny.

Ref 5

you

save

penny,

you

earn

penny.

Ref 6

Each

penny

you

save

penny

you

earn.

Ref 7

The

you

save,

the

you

earn.

Ref 8

Saving

means

earning.

Ref 9

pays

save.

Ref 10

pays

save

your

pennies.

Ref 11

penny

saved

penny

earned.

Ref 12

penny

saved

penny

earned.

Ref 13

penny

saved

penny

earned.

Ref 14

penny

saved

penny

earned.

Ref 15

penny

saved

penny

earned.

Output 0

Saves

one

penny

equal

that

has

made

one

penny.

N-grams

Saves	one	penny	to	be	equal	to	that	has	made	one	penny.
		penny	to								penny.

Output 1

penny

one

equal

one

penny

N-grams

to	penny	to	one	equal	one	penny	.
to	penny					penny

Output 2

save

penny

earned

equivalent

pence.

N-grams

To	save	a	penny	earned	is	equivalent	to	1	pence.
	save	a	penny		is		to
	save a
		a penny

Output 3

Reduced

one

penny

equal

Zheng

one

penny.

N-grams

Reduced	one	penny	to	equal	Zheng	one	penny.
		penny	to				penny.

Output 4

Saves

one

penny

equal

that

has

made

one

penny.

N-grams

Saves	one	penny	to	be	equal	to	that	has	made	one	penny.
		penny	to								penny.

Sentence 128) BLEU: 0 (0.6/0.5/0.3333/0) ; 0 (0.4/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.6/0.5/0.3333/0)

Source

��

�k�H

��

�ʾ

�C

Ref 0

That

man

crude.

Ref 1

That

man

uncouth.

Ref 2

He's

rude.

Ref 3

That

guy

crude.

Ref 4

That

guy

goon.

Ref 5

That

guy's

thug.

Ref 6

That

guy

hood.

Ref 7

That

guy

rough.

Ref 8

That

fellow

sloppy.

Ref 9

That

dude

not

careful.

Ref 10

What

crude

man.

Ref 11

He's

mean

man.

Ref 12

That

man

crude.

Ref 13

That

guy

coarse.

Ref 14

That

man

primitive.

Ref 15

That

guy

obscene.

Output 0

That

man

very

stupid.

N-grams

That	man	is	very	stupid.
That	man	is
That man
That man is
	man is

Output 1

man

that

very

N-grams

man	that	is	very	.
man		is

Output 2

Man

that

very

rude.

N-grams

Man	that	is	very	rude.
		is		rude.

Output 3

That

man

very

stupid.

N-grams

That	man	is	very	stupid.
That	man	is
That man
That man is
	man is

Output 4

That

man

very

uncouthly.

N-grams

That	man	is	very	uncouthly.
That	man	is
That man
That man is
	man is

Sentence 129) BLEU: 0 (0.25/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.1667/0/0/0)

Source

��

�j

�I

�n

��

�C

Ref 0

Please

speak

little

louder.

Ref 1

Please

speak

up.

Ref 2

Please

talk

loudly.

Ref 3

Please

speak

little

loudly.

Ref 4

Could

you

speak

up,

please?

Ref 5

Could

you

talk

bit

louder,

please?

Ref 6

Could

you

say

bit

louder,

please?

Ref 7

Could

you

please

speak

little

louder?

Ref 8

Would

you

speak

little

louder?

Ref 9

you

mind

speaking

little?

Ref 10

Could

you

please

speak

little

louder?

Ref 11

Would

you

mind

speaking

bit?

Ref 12

Kindly

talk

slightly

louder

voice.

Ref 13

Please

speak

little

bit.

Ref 14

Please

speak

with

little

volume.

Ref 15

Please

speak

more.

Output 0

Great

point,

please

speak.

N-grams

Great	point,	please	speak.
		please

Output 1

please

speak

N-grams

please	speak	.
please	speak
please speak

Output 2

Great

Point,

please

speak.

N-grams

Great	Point,	please	speak.
		please

Output 3

Please

greatly

order

voice

speak.

N-grams

Please	greatly	order	a	voice	to	speak.
Please			a

Output 4

Please

the

big

spot

sound

say.

N-grams

Please	the	big	spot	sound	say.
Please

Sentence 130) BLEU: 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0)

Source

�n�D

��

�H

Ref 0

formal

dress

required?

Ref 1

formal

dress?

Ref 2

the

dress

code

formal?

Ref 3

formal

attire

required?

Ref 4

need

dress

formally?

Ref 5

formal

dress

necessary?

Ref 6

have

wear

formal

dress?

Ref 7

have

dress

formal?

Ref 8

Must

dress

formal?

Ref 9

formal

dress

necessary?

Ref 10

have

wear

formal

dress?

Ref 11

necessary

dress

formally?

Ref 12

Are

required

dress

formally?

Ref 13

there

dress

code?

Ref 14

required

dress

formally?

Ref 15

have

dress

formally?

Output 0

you

request

packing?

N-grams

Do	you	request	to	be	packing?
Do			to

Output 1

request

N-grams

request

Output 2

Request

loaded

it?

N-grams

Request

loaded

it?

Output 3

you

request

packing?

N-grams

Do	you	request	to	be	packing?
Do			to

Output 4

Request

true

thing?

N-grams

Request

true

thing?

Sentence 131) BLEU: 0 (0.6667/0.2/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.4286/0/0/0)

Source

��

�L

�o

��

�r��

�C

��

�A

�C

Ref 0

enjoyed

it.

Thank

you.

Ref 1

loved

it.

Ref 2

was

great.

Ref 3

was

wonderful.

Ref 4

That

was

great,

thanks.

Ref 5

Thanks,

was

really

special.

Ref 6

Thanks,

was

real

treat.

Ref 7

That

was

delicious.

Ref 8

Thank

you

very

much.

Ref 9

That

was

very

nice.

Ref 10

What

nice

meal.

Thank

you.

Ref 11

That

was

lovely

meal.

Thanks.

Ref 12

was

lovely.

Thanks.

Ref 13

was

good.

Thank

you.

Ref 14

was

wonderful.

Thank

you.

Ref 15

was

wonderful

meal.

Thank

you

Output 0

very

happy.

Thank

you.

N-grams

I	am	very	happy.	Thank	you.
I		very		Thank	you.
				Thank you.

Output 1

very

thank

you

happily

N-grams

i	very	thank	you	happily	.
	very		you

Output 2

very

happy.

Thank

you.

N-grams

I	am	very	happy.	Thank	you.
I		very		Thank	you.
				Thank you.

Output 3

lead

very

happily.

Thank

you.

N-grams

I	lead	very	happily.	Thank	you.
I		very		Thank	you.
				Thank you.

Output 4

cross

very

much

happily.

Thanks

you.

N-grams

I	cross	very	much	happily.	Thanks	you.
I		very				you.

Sentence 132) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.5714/0.3333/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.6364/0.1/0/0) ; 0 (0.375/0/0/0)

Source

��

�w�w

�p��

�h��

�H

Ref 0

How

far

behind

schedule?

Ref 1

How

far

behind

schedule

it?

Ref 2

How

far

behind

it?

Ref 3

How

much

behind

schedule

it?

Ref 4

How

much

delay

going

be?

Ref 5

How

late

will

be?

Ref 6

How

far

off

schedule

it?

Ref 7

How

much

behind

schedule

it?

Ref 8

How

late

running

behind

schedule?

Ref 9

Approximately

how

much

running

late

by?

Ref 10

How

late

it?

Ref 11

How

long

the

delay?

Ref 12

How

long

will

delayed?

Ref 13

How

much

behind

it's

scheduled

time?

Ref 14

How

late

behind

schedule?

Ref 15

How

long

going

after

the

scheduled

time?

Output 0

behind

schedule

number?

N-grams

It	is	behind	schedule	number?
	is	behind	schedule
		behind schedule

Output 1

behind

schedule

how

does

plan

N-grams

it	behind	schedule	how	does	plan	?
it	behind	schedule	how
it behind
	behind schedule

Output 2

behind

schedule

number?

N-grams

It	is	behind	schedule	number?
	is	behind	schedule
		behind schedule

Output 3

How

much

does

get

behind

with

schedule

plan?

N-grams

How	much	does	it	get	behind	with	to	schedule	to	plan?
How	much		it		behind		to	schedule
How much

Output 4

Does

fall

behind

predetermined

plan

how

many?

N-grams

Does	it	fall	behind	predetermined	plan	how	many?
	it		behind			how

Sentence 133) BLEU: 0 (0.625/0.2857/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.625/0.2857/0/0) ; 0 (0.4286/0/0/0)

Source

��

�F

��U

�C

Ref 0

I'm

glad

have

been

help.

Ref 1

I'm

glad

could

assistance.

Ref 2

I'm

happy

could

help

out.

Ref 3

I'm

glad

could

help

out.

Ref 4

Glad

have

been

assistance.

Ref 5

I'm

glad

could

help.

Ref 6

was

pleasure

assistance.

Ref 7

I'm

honored

have

been

able

help.

Ref 8

I'm

happy

have

been

useful.

Ref 9

It's

pleasure

have

been

assistance.

Ref 10

I'm

glad

could

help.

Ref 11

I'm

happy

help.

Ref 12

was

pleasure

help

you.

Ref 13

glad

that

was

useful.

Ref 14

happy

that

was

able

help.

Ref 15

glad

that

was

some

use.

Output 0

very

happy

provide

help.

N-grams

I	am	very	happy	to	provide	a	help.
I	am		happy	to			help.
I am			happy to

Output 1

provide

help

very

N-grams

i	am	to	provide	help	very	.
	am	to		help

Output 2

pleased

provide

help.

N-grams

I	am	pleased	to	provide	help.
I	am		to		help.
I am

Output 3

very

happy

provide

help.

N-grams

I	am	very	happy	to	provide	a	help.
I	am		happy	to			help.
I am			happy to

Output 4

have

provided

the

help

very

happily.

N-grams

I	have	provided	the	help	very	happily.
I	have			help

Sentence 134) BLEU: 0 (0.125/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.125/0/0/0)

Source

��

�H

Ref 0

How

about

the

Palladium?

Ref 1

What

about

the

Palladium?

Ref 2

What

you

think

about

the

Palladium?

Ref 3

How

does

the

Palladium

sound?

Ref 4

What

about

the

Palladium?

Ref 5

And

the

Palladium?

Ref 6

What

about

the

Palladium?

Ref 7

What

about

the

Palladium?

Ref 8

Would

you

the

Palladium?

Ref 9

Does

the

Palladium

appeal

you?

Ref 10

The	Palladium?

Ref 11

What

about

the

Palladium?

Ref 12

Shall

the

Palladium?

Ref 13

How

does

the

Palladium

sound?

Ref 14

What

you

think

the

Palladium?

Ref 15

Shall

try

the

Palladium?

Output 0

The

handkerchief

russ's

idol

what

kind

of?

N-grams

The	handkerchief	russ's	idol	is	what	kind	of?
The

Output 1

how

the

idol

N-grams

how	the	idol	of	?
	the

Output 2

Pallas

how

the

statue-like?

N-grams

Pallas	how	the	statue-like?
		the

Output 3

The

pulls

the

idol

how?

N-grams

The	Pa	pulls	the	idol	of	Si	how?
The			the

Output 4

The

handkerchief

Russ's

idol

what

kind

of?

N-grams

The	handkerchief	Russ's	idol	is	what	kind	of?
The

Sentence 135) BLEU: 1 (1/1/1/1) ; 0 (0.1667/0/0/0) ; 1 (1/1/1/1) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.5/0/0/0)

Source

��

�ϥ�

�Ȧ�

�䲼

��

�H

Ref 0

Can

use

traveler's

checks?

Ref 1

you

take

traveler's

checks?

Ref 2

Can

traveler's

checks

used?

Ref 3

you

traveler's

checks?

Ref 4

Can

pay

with

traveler's

checks?

Ref 5

Are

traveler's

checks

OK?

Ref 6

Are

traveler's

checks

acceptable?

Ref 7

you

traveler's

checks?

Ref 8

you

take

traveler's

checks?

Ref 9

May

pay

with

traveler's

checks?

Ref 10

okay

use

traveler's

checks?

Ref 11

May

use

traveler's

checks?

Ref 12

you

traveler's

checks?

Ref 13

May

use

traveler's

check?

Ref 14

possible

use

traveler's

check?

Ref 15

you

traveler's

checks?

Output 0

Can

use

traveler's

checks?

N-grams

Can	I	use	traveler's	checks?
Can	I	use	traveler's	checks?
Can I		use traveler's
Can I use			traveler's checks?
Can I use traveler's
	I use
	I use traveler's
	I use traveler's checks?
		use traveler's checks?

Output 1

can

use

check

N-grams

can	i	use	's	check	?
		use

Output 2

Can

use

traveler's

checks?

N-grams

Can	I	use	traveler's	checks?
Can	I	use	traveler's	checks?
Can I		use traveler's
Can I use			traveler's checks?
Can I use traveler's
	I use
	I use traveler's
	I use traveler's checks?
		use traveler's checks?

Output 3

Can

use

trip

check?

N-grams

Can	I	use	trip	check?
Can	I	use		check?
Can I
Can I use
	I use

Output 4

can

use

the

traller's

check?

N-grams

I	can	use	the	traller's	check?
I		use			check?

Sentence 136) BLEU: 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0)

Source

�O��

�C

Ref 0

Yes.

Ref 1

Alright.

Ref 2

OK.

Ref 3

Good.

Ref 4

Sure.

Ref 5

OK.

Ref 6

That's

right.

Ref 7

problem.

Ref 8

Yes,

it's

possible.

Ref 9

Certainly.

Ref 10

Okay.

Ref 11

Fine.

Ref 12

That's

right.

Ref 13

That's

correct.

Ref 14

Uh-huh.

Ref 15

Yep.

Output 0

Yes.

N-grams

Yes.

Output 1

yes

N-grams

yes

Output 2

Yes.

N-grams

Yes.

Output 3

Yes.

N-grams

Yes.

Output 4

Yes.

N-grams

Yes.

Sentence 137) BLEU: 1 (1/1/1/1) ; 0 (0.6667/0.6/0.25/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 1 (1/1/1/1)

Source

��

��g

�o

�i

��

�C

Ref 0

Please

fill

out

this

form.

Ref 1

Please

fill

this

form.

Ref 2

Please

complete

this

form.

Ref 3

Please

complete

the

form.

Ref 4

Please

complete

this

form.

Ref 5

Please

fill

this

form.

Ref 6

Please

enter

the

information

this

form.

Ref 7

Please

complete

this

form.

Ref 8

Could

you

fill

out

this

form

please?

Ref 9

You

are

requested

complete

this

form.

Ref 10

Would

you

mind

filling

this

form.

Ref 11

Could

you

complete

this

form?

Ref 12

Kindly

fill

the

form.

Ref 13

Please

fill

out

this

document.

Ref 14

Please

write

your

information

this

form.

Ref 15

Please

fill

out

this

paper.

Output 0

Please

fill

this

form.

N-grams

Please	fill	in	this	form.
Please	fill	in	this	form.
Please fill		in this
Please fill in			this form.
Please fill in this
	fill in
	fill in this
	fill in this form.
		in this form.

Output 1

please

fill

this

form

N-grams

please	fill	in	this	form	.
	fill	in	this	form
	fill in		this form
	fill in this
		in this

Output 2

Please

fill

this

form.

N-grams

Please	fill	in	this	form.
Please	fill	in	this	form.
Please fill		in this
Please fill in			this form.
Please fill in this
	fill in
	fill in this
	fill in this form.
		in this form.

Output 3

Please

fill

this

form.

N-grams

Please	fill	in	this	form.
Please	fill	in	this	form.
Please fill		in this
Please fill in			this form.
Please fill in this
	fill in
	fill in this
	fill in this form.
		in this form.

Output 4

Please

fill

this

form.

N-grams

Please	fill	in	this	form.
Please	fill	in	this	form.
Please fill		in this
Please fill in			this form.
Please fill in this
	fill in
	fill in this
	fill in this form.
		in this form.

Sentence 138) BLEU: 0 (0.5/0/0/0) ; 0 (0.625/0/0/0) ; 0 (0.4167/0/0/0) ; 0 (0.5714/0.07692/0/0) ; 0 (0.5/0/0/0)

Source

��

�i�H

�[��

�i��

��

��@

��

��j

�t�X

��

�H

Ref 0

there

tour

see

shows

theaters?

Ref 1

there

tour

the

shows

theaters?

Ref 2

there

tour

with

shows

theaters?

Ref 3

Are

there

theaters

shows

any

the

tours?

Ref 4

there

theater

show

tour?

Ref 5

you

have

tour

that

goes

shows

theater

productions?

Ref 6

you

have

theater

other

performance

tours?

Ref 7

Are

there

any

tours

that

include

shows

plays?

Ref 8

you

know

any

tours

with

shows

plays?

Ref 9

there

something

tour

that

includes

watching

shows

plays?

Ref 10

there

any

tour

shows

theaters

available?

Ref 11

you

have

tour

shows

theaters?

Ref 12

Could

join

tour

for

shows

theaters?

Ref 13

Are

there

any

tours

see

shows

plays?

Ref 14

there

any

tours

for

shows

plays?

Ref 15

Are

the

show

play

tours

available?

Output 0

There

May

watch

the

display

the

play

tours?

N-grams

There	is	May	watch	the	display	or	the	play	tours?
				the		or		play	tours?

Output 1

there

have

watch

the

exhibition

the

N-grams

there	have	watch	the	exhibition	or	the	?
there	have		the		or

Output 2

There

have

able

watch

the

exhibition

theatrical

tour

it?

N-grams

There	have	be	able	to	watch	the	exhibition	or	theatrical	tour	it?
	have			to		the		or		tour

Output 3

Does

there

have

the

performance

the

circuit

that

can

watch

exhibition

drama?

N-grams

Does

there

have

the

performance

the

circuit

that

can

watch

exhibition

drama?

there

have

the

performance

that

of the

Output 4

There

may

watch

the

display

the

play

tours?

N-grams

There	is	may	watch	the	display	or	the	play	tours?
				the		or		play	tours?

Sentence 139) BLEU: 0 (0.4/0.25/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.4/0.25/0/0)

Source

��

�Q

�n

�@

��

�p��

��

�C

Ref 0

I'd

the

smallest

one

you

have.

Ref 1

Please

give

the

smallest

one

you

have.

Ref 2

I'd

the

smallest

one,

please.

Ref 3

Please

give

the

smallest

one.

Ref 4

The

smallest

you

have,

please.

Ref 5

The

smaller,

the

better,

please.

Ref 6

small

you

have,

please.

Ref 7

The

smallest,

please.

Ref 8

I'd

prefer

the

smallest,

please.

Ref 9

want

the

smallest,

please.

Ref 10

Please

give

the

smallest

one

you

have.

Ref 11

want

the

smallest

one

you

have.

Ref 12

The

smallest

one,

please.

Ref 13

would

the

smallest

available.

Ref 14

would

order

the

smallest

one.

Ref 15

would

the

tiniest

one

available.

Output 0

want

minimum

number.

N-grams

I	want	a	minimum	number.
I	want
I want

Output 1

want

minimum

number

N-grams

i	want	a	minimum	number	.
	want

Output 2

want

minimum

number.

N-grams

I	want	a	minimum	number.
I	want
I want

Output 3

want

minimum

number.

N-grams

I	want	a	minimum	number.
I	want
I want

Output 4

want

most

trumpet.

N-grams

I	want	a	most	trumpet.
I	want
I want

Sentence 140) BLEU: 0.4526 (0.7692/0.5/0.3636/0.3) ; 0 (0.4667/0.2143/0.07692/0) ; 0.4526 (0.7692/0.5/0.3636/0.3) ; 0.2788 (0.6875/0.4/0.2857/0.07692) ; 0 (0.7857/0.3846/0.08333/0)

Source

�k��ҤH

�A

��

�Q

��

�z

�O�_

�Q

�n

�@

�M

��

�C

Ref 0

Baroness,

I've

been

sent

ask

you

would

drink.

Ref 1

Baroness,

was

asked

find

out

you

would

drink.

Ref 2

Baroness,

was

told

come

and

ask

you

would

something

drink.

Ref 3

Baroness,

I've

been

sent

ask

you

there

anything

you

would

drink.

Ref 4

Baroness,

would

inquire

whether

you

would

drink.

Ref 5

Baroness,

here

inquire

about

whether

you

would

have

drink.

Ref 6

Baroness,

I've

been

asked

inquire

whether

you

would

beverage.

Ref 7

Baroness,

they

have

instructed

ask

you

there

anything

you'd

drink.

Ref 8

Excuse

me,

Baroness,

was

ordered

come

and

ask

you

whether

you'd

drink.

Ref 9

Pardon

me,

Baroness,

have

been

told

ask

you'd

interested

having

something

drink.

Ref 10

Baroness,

was

sent

ask

you

would

have

drink.

Ref 11

Baroness,

was

ordered

ask

could

get

you

something

drink.

Ref 12

Baroness,

someone

sent

ask

you

wanted

drink.

Ref 13

lady,

have

been

sent

ask

you

would

something

drink.

Ref 14

lady,

would

ask

you

would

something

drink.

Ref 15

lady,

have

been

dispatched

ask

you

would

something

drink.

Output 0

Baroness,

was

sent

ask

whether

you

want

cup

drink.

N-grams

Baroness,

was

sent

ask

whether

you

want

cup

drink.

Baroness,

was

sent

ask

whether

you

drink.

Baroness, I

was sent

to ask

whether you

Baroness, I was

sent to

Baroness, I was sent

I was

sent to ask

I was sent

I was sent to

was sent to

was sent to ask

Output 1

baroness

sent

ask

whether

you

want

cup

drink

N-grams

baroness

sent

ask

whether

you

want

cup

drink

sent

ask

whether

you

sent to

whether you

sent to ask

to ask

Output 2

Baroness,

was

sent

ask

whether

you

want

cup

drink.

N-grams

Baroness,

was

sent

ask

whether

you

want

cup

drink.

Baroness,

was

sent

ask

whether

you

drink.

Baroness, I

was sent

to ask

whether you

Baroness, I was

sent to

Baroness, I was sent

I was

sent to ask

I was sent

I was sent to

was sent to

was sent to ask

Output 3

Baroness,

sent

ask

you

whether

wants

cup

drink

of.

N-grams

Baroness,

sent

ask

you

whether

wants

cup

drink

of.

Baroness,

sent

ask

you

whether

Baroness, I

sent to

ask you

Baroness, I am

sent to ask

you whether

I am

sent to ask you

to ask

to ask you

ask you whether

Output 4

Baroness,

sent

ask

whether

you

want

cup

drink.

N-grams

Baroness,

sent

ask

whether

you

want

cup

drink.

Baroness,

sent

ask

whether

you

drink.

Baroness, I

sent to

whether you

to drink.

sent to ask

to ask

Sentence 141) BLEU: 0 (0.5/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.5/0/0/0)

Source

�A

�ݭn

��

�H

Ref 0

you

need

deposit?

Ref 1

deposit

necessary?

Ref 2

deposit

needed?

Ref 3

need

deposit?

Ref 4

deposit

required?

Ref 5

deposit

necessary?

Ref 6

you

take

deposit?

Ref 7

Will

deposit

necessary?

Ref 8

Will

you

require

deposit

from

me?

Ref 9

Will

have

give

you

deposit?

Ref 10

you

need

leave

deposit?

Ref 11

have

leave

deposit?

Ref 12

Must

leave

deposit?

Ref 13

deposit

required?

Ref 14

need

leave

deposit?

Ref 15

have

pay

deposit?

Output 0

You

need

the

deposit?

N-grams

You	need	the	deposit?
	need		deposit?

Output 1

you

need

deposit

N-grams

you	need	deposit	?
you	need	deposit
you need

Output 2

You

need

deposit

it?

N-grams

You	need	to	deposit	it?
	need	to	deposit
	need to

Output 3

you

need

security

deposit?

N-grams

Do	you	need	security	deposit?
Do	you	need		deposit?
Do you
Do you need
	you need

Output 4

You

need

the

deposit?

N-grams

You	need	the	deposit?
	need		deposit?

Sentence 142) BLEU: 0 (0.4/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.4/0/0/0) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.5/0/0/0)

Source

��

�D�`

�A�X

�A

�C

Ref 0

suits

you

very

well.

Ref 1

looks

great

you.

Ref 2

looks

good

you.

Ref 3

You

look

good

this.

Ref 4

looks

great

you.

Ref 5

It's

you.

Ref 6

It's

perfect

you.

Ref 7

That

looks

great

you.

Ref 8

That

really

suits

you.

Ref 9

You

look

smashing

that.

Ref 10

looks

nice

you.

Ref 11

fits

you

well.

Ref 12

It's

very

good

fit.

Ref 13

looks

good

you.

Ref 14

seems

very

suitable.

Ref 15

goes

with

you.

Output 0

ideal

for

you.

N-grams

It	is	ideal	for	you.
It				you.

Output 1

you

N-grams

it	is	you	.
		you

Output 2

ideal

for

you.

N-grams

It	is	ideal	for	you.
It				you.

Output 3

suits

you

very

much.

N-grams

It	suits	you	very	much.
It	suits	you	very
It suits		you very
It suits you
It suits you very
	suits you
	suits you very

Output 4

suitable

you.

N-grams

It	is	suitable	you.
It			you.

Sentence 143) BLEU: 0 (0.4/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.5/0.3333/0/0)

Source

��

�γJ

�D

�F

�C

Ref 0

omelette

cold.

Ref 1

omelettes

have

gotten

cold.

Ref 2

omelettes

are

getting

cold.

Ref 3

These

omelettes

are

getting

cold.

Ref 4

omelette

has

gotten

cold.

Ref 5

This

omelette

not

hot

all.

Ref 6

This

omelette

cold.

Ref 7

omelette

has

gotten

cold.

Ref 8

seems

that

omelette

cold.

Ref 9

This

omelette

has

cooled

down.

Ref 10

omelette

gone

cold.

Ref 11

omelette

not

warm.

Ref 12

This

cold

omelette.

Ref 13

This

omelette

has

become

cold.

Ref 14

This

omelette

not

hot.

Ref 15

This

omelette

has

cooled.

Output 0

fried

egg

cool.

N-grams

My	fried	egg	is	cool.
My			is

Output 1

cool

N-grams

my	cool	.
my

Output 2

cold

omelet.

N-grams

My	cold	omelet.
My	cold

Output 3

fried

egg

cool.

N-grams

My	fried	egg	is	cool.
My			is

Output 4

omelette

was

cool.

N-grams

My	omelette	was	cool.
My	omelette
My omelette

Sentence 144) BLEU: 0.6223 (0.9/0.7778/0.5/0.4286) ; 0.3656 (0.625/0.4286/0.3333/0.2) ; 0.6223 (0.9/0.7778/0.5/0.4286) ; 0 (0.8571/0.6667/0.2/0) ; 0 (0.75/0/0/0)

Source

��

�S��

��

�A

��

�C

Ref 0

I'm

afraid

don't

understand

what

you're

saying.

Ref 1

I'm

sorry

but

can't

understand

what

you

are

saying.

Ref 2

I'm

afraid

what

you

are

saying

doesn't

make

any

sense

me.

Ref 3

I'm

sorry

but

don't

understand.

Ref 4

can't

make

out

what

you

are

saying

all.

Ref 5

can't

figure

out

what

you

are

saying

all.

Ref 6

can't

catch

your

meaning

all.

Ref 7

don't

seem

understand

what

you're

saying.

Ref 8

can't

seem

get

what

you're

saying.

Ref 9

don't

seem

able

catch

what

you're

saying.

Ref 10

sorry

but

don't

understand

what

you

are

telling

me.

Ref 11

I'm

sorry

say

that

didn't

catch

what

you're

saying.

Ref 12

Sorry,

but

don't

understand

word

you

say.

Ref 13

sorry

but

haven't

understood

anything

you've

been

saying.

Ref 14

sorry

but

not

understand.

Ref 15

terribly

sorry

but

not

understand

what

you

are

saying.

Output 0

afraid

not

understand

what

you

said.

N-grams

I	am	afraid	I	do	not	understand	what	you	said.
I	am	afraid	I	do	not	understand	what	you
I am		afraid I		do not		understand what
			I do		not understand		what you
			I do not			understand what you
			I do not understand
				do not understand
				do not understand what
					not understand what
					not understand what you

Output 1

not

understand

what

you

perhaps

say

N-grams

i	not	understand	what	you	perhaps	say	.
	not	understand	what	you		say
	not understand		what you
	not understand what
	not understand what you
		understand what
		understand what you

Output 2

afraid

not

understand

what

you

said.

N-grams

I	am	afraid	I	do	not	understand	what	you	said.
I	am	afraid	I	do	not	understand	what	you
I am		afraid I		do not		understand what
			I do		not understand		what you
			I do not			understand what you
			I do not understand
				do not understand
				do not understand what
					not understand what
					not understand what you

Output 3

Perhaps

didn't

understand

what

you

say.

N-grams

Perhaps	I	didn't	understand	what	you	say.
	I	didn't	understand	what	you	say.
	I didn't		understand what		you say.
			understand what you
				what you

Output 4

Perhaps

have

not

understood

you

say.

N-grams

Perhaps	I	have	not	understood	you	to	say.
	I		not	understood	you	to	say.

Sentence 145) BLEU: 0.5874 (1/0.625/0.5714/0.3333) ; 0 (0.7143/0/0/0) ; 0 (0.6667/0/0/0) ; 0.4111 (1/0.4286/0.3333/0.2) ; 0.5874 (1/0.625/0.5714/0.3333)

Source

�ڭ�

�b

�o��

�i�H

��

�H

Ref 0

What

kind

gambling

can

here?

Ref 1

What

sort

gambling

can

here?

Ref 2

What

kind

gambling

there

here?

Ref 3

What

types

gambling

are

here?

Ref 4

What

sort

gambling

can

here.

Ref 5

What

kinds

things

can

gamble

here?

Ref 6

What

can

gamble

here?

Ref 7

What

sort

gambling

you

offer

here?

Ref 8

What

are

the

gambling

options

here?

Ref 9

What

can

here

terms

gambling?

Ref 10

What

types

gambling

games

are

available

here?

Ref 11

Which

gambling

games

can

play

here?

Ref 12

Which

gambling

games

you

offer?

Ref 13

What

types

gambling

are

available

here?

Ref 14

What

sorts

gambling

can

here?

Ref 15

What

types

gaming

can

here?

Output 0

Which

kind

gambling

can

play

here?

N-grams

Which	kind	of	gambling	can	we	play	in	here?
Which	kind	of	gambling	can	we	play	in	here?
	kind of		gambling can		we play
	kind of gambling			can we
	kind of gambling can
		of gambling		can we play
		of gambling can
		of gambling can we
			gambling can we

Output 1

can

play

here

which

gambling

N-grams

we	can	play	here	which	gambling	?
we	can	play	here		gambling

Output 2

can

play

here

which

gambling?

N-grams

We	can	play	here	which	gambling?
	can	play	here		gambling?

Output 3

Which

the

gamble

can

play

here?

N-grams

Which	on	the	gamble	can	we	play	here?
Which	on	the	gamble	can	we	play	here?
				can we		play here?
				can we play
				can we play here?
					we play
					we play here?

Output 4

Which

kind

gambling

can

play

here?

N-grams

Which	kind	of	gambling	can	we	play	in	here?
Which	kind	of	gambling	can	we	play	in	here?
	kind of		gambling can		we play
	kind of gambling			can we
	kind of gambling can
		of gambling		can we play
		of gambling can
		of gambling can we
			gambling can we

Sentence 146) BLEU: 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.5/0.4/0.25/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0 (0.5/0/0/0)

Source

�A

��

ñ��

��

�H

Ref 0

you

have

visa?

Ref 1

you

have

your

visa?

Ref 2

Did

you

obtain

visa?

Ref 3

Did

you

get

visa?

Ref 4

Are

you

carrying

visa?

Ref 5

you

possess

visa?

Ref 6

Have

you

visa?

Ref 7

Are

you

holding

visa?

Ref 8

you

possess

visa?

Ref 9

Have

you

got

visa?

Ref 10

Are

you

possession

visa?

Ref 11

Have

you

gotten

visa?

Ref 12

Did

you

get

visa?

Ref 13

Have

you

acquired

visa?

Ref 14

you

have

visa?

Ref 15

you

have

visa?

Output 0

you

have

VISA?

N-grams

Do	you	have	a	VISA?
Do	you	have	a
Do you		have a
Do you have
Do you have a
	you have
	you have a

Output 1

you

have

visa

N-grams

do	you	have	a	visa	?
	you	have	a
	you have
	you have a
		have a

Output 2

you

have

visa?

N-grams

Do	you	have	a	visa?
Do	you	have	a	visa?
Do you		have a
Do you have			a visa?
Do you have a
	you have
	you have a
	you have a visa?
		have a visa?

Output 3

you

have

visa?

N-grams

Do	you	have	a	visa?
Do	you	have	a	visa?
Do you		have a
Do you have			a visa?
Do you have a
	you have
	you have a
	you have a visa?
		have a visa?

Output 4

You

have

the

visa?

N-grams

You	have	the	visa?
	have		visa?

Sentence 147) BLEU: 1 (1/1/1/1) ; 0 (0.7143/0.3333/0/0) ; 1 (1/1/1/1) ; 0.5704 (0.8889/0.625/0.5714/0.3333) ; 0 (0.5714/0.3333/0/0)

Source

��

�Q

�n

�@

��

��V

��y

��

�ж�

�C

Ref 0

I'd

room

facing

the

beach.

Ref 1

Please

give

room

facing

the

beach.

Ref 2

I'd

room

looking

out

the

beach.

Ref 3

I'd

room

with

view

the

beach.

Ref 4

beach-front

room

would

nice.

Ref 5

room

with

view

the

beach

would

great.

Ref 6

would

nice

have

room

overlooking

the

beach.

Ref 7

want

room

the

beach.

Ref 8

Can

have

room

facing

the

beach,

please?

Ref 9

room

facing

the

beach

would

nice.

Ref 10

Could

you

get

room

with

beach

view?

Ref 11

want

room

with

view

the

beach.

Ref 12

room

with

beach

view

would

best.

Ref 13

would

room

with

beach

view.

Ref 14

would

prefer

room

that

faces

the

beach.

Ref 15

would

room

that

has

view

the

beach.

Output 0

I'd

room

facing

the

beach.

N-grams

I'd	like	a	room	facing	the	beach.
I'd	like	a	room	facing	the	beach.
I'd like		a room		facing the
I'd like a			room facing		the beach.
I'd like a room				facing the beach.
	like a		room facing the
	like a room
	like a room facing
		a room facing
		a room facing the
			room facing the beach.

Output 1

room

the

beach

want

N-grams

i	a	room	the	beach	want	.
	a	room	the	beach	want
	a room		the beach

Output 2

I'd

room

facing

the

beach.

N-grams

I'd	like	a	room	facing	the	beach.
I'd	like	a	room	facing	the	beach.
I'd like		a room		facing the
I'd like a			room facing		the beach.
I'd like a room				facing the beach.
	like a		room facing the
	like a room
	like a room facing
		a room facing
		a room facing the
			room facing the beach.

Output 3

want

room

that

faces

sea

beach.

N-grams

I	want	a	room	that	faces	to	sea	beach.
I	want	a	room	that	faces	to		beach.
I want		a room		that faces
I want a			room that
I want a room
	want a		room that faces
	want a room
		a room that
		a room that faces

Output 4

want

one

face

the

beach

room.

N-grams

I	want	one	face	the	beach	room.
I	want			the	beach
I want				the beach

Sentence 148) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.6/0.25/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.8/0.5/0.3333/0)

Source

��

�Q

�n

�@

��

��]��

�C

Ref 0

I'd

ballpoint

pen.

Ref 1

want

ballpoint

pen.

Ref 2

ballpoint

pen

what

want.

Ref 3

I'm

looking

for

ballpoint

pen.

Ref 4

need

ballpoint

pen.

Ref 5

want

ballpoint

pen.

Ref 6

I'm

hoping

get

ballpoint

pen.

Ref 7

I'm

looking

for

ballpoint

pen.

Ref 8

want

ballpoint

pen.

Ref 9

I'd

get

ballpoint

pen.

Ref 10

I'm

looking

for

ballpoint

pen.

Ref 11

would

buy

ballpoint

pen.

Ref 12

want

ballpoint

pen.

Ref 13

looking

for

ballpoint

pen.

Ref 14

would

buy

ballpoint

pen.

Ref 15

want

ballpoint

pen.

Output 0

want

ball-point

pen.

N-grams

I	want	a	ball-point	pen.
I	want	a		pen.
I want
I want a
	want a

Output 1

want

pen

N-grams

i	want	a	pen	.
	want	a	pen
	want a

Output 2

want

ball-point

pen.

N-grams

I	want	a	ball-point	pen.
I	want	a		pen.
I want
I want a
	want a

Output 3

want

circle

bead

pen.

N-grams

I	want	a	circle	bead	pen.
I	want	a			pen.
I want
I want a
	want a

Output 4

want

ball

pen.

N-grams

I	want	a	ball	pen.
I	want	a		pen.
I want
I want a
	want a

Sentence 149) BLEU: 1 (1/1/1/1) ; 0 (0.6/0.25/0/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0 (0.25/0/0/0)

Source

��

�h��

��

�H

Ref 0

How

much

it?

Ref 1

How

much

does

cost?

Ref 2

What

the

price?

Ref 3

What

does

cost?

Ref 4

How

much

does

cost?

Ref 5

How

much?

Ref 6

How

much

does

come

to?

Ref 7

How

much

will

be?

Ref 8

What's

the

cost?

Ref 9

How

much

does

cost?

Ref 10

How

much

does

cost?

Ref 11

How

much?

Ref 12

What

does

cost?

Ref 13

How

much?

Ref 14

What's

the

price?

Ref 15

How

much

does

cost?

Output 0

How

much

it?

N-grams

How	much	is	it?
How	much	is	it?
How much		is it?
How much is
How much is it?
	much is
	much is it?

Output 1

how

much

N-grams

how	much	is	it	?
	much	is	it
	much is

Output 2

How

much

it?

N-grams

How	much	is	it?
How	much	is	it?
How much		is it?
How much is
How much is it?
	much is
	much is it?

Output 3

How

much

it?

N-grams

How	much	is	it?
How	much	is	it?
How much		is it?
How much is
How much is it?
	much is
	much is it?

Output 4

Its

how

much

money?

N-grams

Its	how	much	money?
		much

Sentence 150) BLEU: 0 (0.5455/0.3/0.1111/0) ; 0 (0.5714/0/0/0) ; 0 (0.2727/0/0/0) ; 0 (0.5455/0.3/0.1111/0) ; 0 (0.75/0.2857/0.1667/0)

Source

�A��

��

�Q

��

�o��

��

�H

�O

��

��l

��

�C

Ref 0

you

have

size

ten?

It's

for

son.

Ref 1

you

have

size

ten?

want

for

son.

Ref 2

I'm

looking

for

size

ten?

It's

for

son.

Ref 3

you

have

this

size

ten?

This

for

son.

Ref 4

you

have

size

ten?

It's

going

for

son.

Ref 5

Would

you

have

ten?

It'll

for

son.

Ref 6

there

size

ten?

It's

for

son.

Ref 7

there

any

size

ten?

I'm

getting

for

son.

Ref 8

Does

come

size

ten?

I'm

buying

for

son.

Ref 9

you

have

any

size

ten

available?

This

for

son.

Ref 10

Would

you

happen

have

size

ten?

I'm

looking

for

something

for

son.

Ref 11

size

ten

available?

I'm

getting

for

son.

Ref 12

you

have

size

ten?

want

for

son.

Ref 13

you

carry

size

ten?

buying

for

son.

Ref 14

carry

size

ten?

for

son.

Ref 15

available

size

ten?

for

son.

Output 0

you

have

the

tenth?

give

son.

N-grams

Do	you	have	the	the	in	the	tenth?	give	my	son.
Do	you	have			in				my	son.
Do you									my son.
Do you have
	you have

Output 1

have

you

the

this

son

N-grams

have	you	the	this	my	son	.
have	you		this	my

Output 2

Have

you

the

10th

this?

Yes

son's.

N-grams

Have	you	on	the	10th	of	this?	Yes	to	my	son's.
	you							to	my

Output 3

you

have

the

tenth?

Give

son.

N-grams

Do	you	have	the	the	in	the	tenth?	Give	my	son.
Do	you	have			in				my	son.
Do you									my son.
Do you have
	you have

Output 4

You

have

ten

this?

for

son.

N-grams

You	have	ten	this?	Is	for	my	son.
	have	ten		Is	for	my	son.
					for my
					for my son.
						my son.

Sentence 151) BLEU: 0 (0.6667/0.5/0/0) ; 0 (0.5/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.6667/0.5/0/0)

Source

��

�G

�h

�C

Ref 0

have

stomachache.

Ref 1

I've

got

stomachache.

Ref 2

stomach

hurts.

Ref 3

stomach

hurting.

Ref 4

stomach

aches.

Ref 5

stomach

hurts.

Ref 6

I'm

having

stomach

pains.

Ref 7

stomach

hurting.

Ref 8

stomach's

not

well.

Ref 9

stomach

doesn't

feel

right.

Ref 10

stomach

hurts.

Ref 11

have

pain

stomach.

Ref 12

I've

got

stomachache.

Ref 13

stomach

hurts.

Ref 14

stomach

bothering

me.

Ref 15

stomach

feels

bad.

Output 0

stomach

ache.

N-grams

My	stomach	ache.
My	stomach
My stomach

Output 1

have

stomach

N-grams

i	have	stomach	.
	have	stomach

Output 2

have

stomach

pain.

N-grams

I	have	stomach	pain.
I	have	stomach
I have

Output 3

have

stomach-ache.

N-grams

I	have	a	stomach-ache.
I	have	a
I have
I have a
	have a

Output 4

stomach

ache.

N-grams

My	stomach	ache.
My	stomach
My stomach

Sentence 152) BLEU: 0.455 (0.9/0.6667/0.5/0.1429) ; 0 (0.5455/0.1/0/0) ; 0.455 (0.9/0.6667/0.5/0.1429) ; 0 (0.8889/0.75/0.2857/0) ; 0 (0.7778/0.375/0/0)

Source

�

�A

��

�{��

��

�C

Ref 0

No,

don't

think

should

that.

Ref 1

No,

don't

think

ought

that.

Ref 2

No,

think

would

bad

idea

for

it.

Ref 3

No,

doing

that

would

bad

idea.

Ref 4

No,

don't

think

ought

that.

Ref 5

No,

think

I'd

better

not

that.

Ref 6

No,

think

would

best

not

that.

Ref 7

Nope,

opinion

that

it's

not

the

right

thing

do.

Ref 8

No,

don't

think

that's

good

idea.

Ref 9

No,

feel

that

shouldn't

that.

Ref 10

No,

think

shouldn't

that.

Ref 11

No,

think

it's

wrong

for

that.

Ref 12

No,

maybe

shouldn't

that.

Ref 13

No,

don't

think

supposed

that.

Ref 14

No,

think

not

supposed

that.

Ref 15

No,

think

that

not

the

proper

procedure.

Output 0

No,

think

should

not

have

that.

N-grams

No,	I	think	I	should	not	have	to	do	that.
No,	I	think	I	should	not		to	do	that.
No, I		think I					to do
No, I think			I should				to do that.
No, I think I								do that.
	I think
	I think I
		think I should

Output 1

think

should

not

that

N-grams

no	,	i	think	i	should	not	do	that	that	.
			think		should	not	do	that
						not do

Output 2

No,

think

should

not

have

that.

N-grams

No,	I	think	I	should	not	have	to	do	that.
No,	I	think	I	should	not		to	do	that.
No, I		think I					to do
No, I think			I should				to do that.
No, I think I								do that.
	I think
	I think I
		think I should

Output 3

Not,

think

that

should

not

that.

N-grams

Not,	I	think	that	I	should	not	do	that.
	I	think	that	I	should	not	do	that.
	I think		that I			not do
	I think that			I should		not do that.
		think that					do that.

Output 4

No,

thought

that

should

not

make

that.

N-grams

No,	I	thought	that	I	should	not	make	that.
No,	I		that	I	should	not		that.
No, I			that I
				I should

Sentence 153) BLEU: 0 (0.4286/0/0/0) ; 0 (0.5714/0/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.375/0.1429/0/0)

Source

�M

�O

�E

�Q

�E

��

�C

Ref 0

One

set

ninety-nine

dollars.

Ref 1

costs

ninety-nine

dollars

for

one

set.

Ref 2

One

set

costs

ninety-nine

dollars.

Ref 3

It's

ninety-nine

dollars

for

one

set.

Ref 4

It's

ninety-nine

dollars

for

one.

Ref 5

One

set

costs

ninety-nine

dollars.

Ref 6

For

one,

it's

ninety-nine

dollars.

Ref 7

It's

ninety-nine

dollars

for

set.

Ref 8

For

set,

ninety-nine

dollars.

Ref 9

That'll

ninety-nine

for

one

set.

Ref 10

It's

ninety-nine

dollars

for

one

set.

Ref 11

You

pay

ninety-nine

dollars

for

one

set.

Ref 12

costs

ninety-nine

dollars

for

one

set.

Ref 13

ninety-nine

dollars

set.

Ref 14

ninety-nine

dollars

for

one

set.

Ref 15

The

price

ninety-nine

dollars

for

each

set.

Output 0

Are

set

U.S.

dollars.

N-grams

Are	a	set	of	99	U.S.	dollars.
	a	set				dollars.

Output 1

set

dollars

N-grams

a	set	of	99	dollars	is	.
a	set			dollars	is

Output 2

Are

set

U.S.

dollars.

N-grams

Are	a	set	of	99	U.S.	dollars.
	a	set				dollars.

Output 3

set

USD

99.

N-grams

A	set	of	is	USD	99.
	set		is

Output 4

set

nine

ten

nine

dollars.

N-grams

A	set	is	nine	ten	nine	US	dollars.
	set	is					dollars.
	set is

Sentence 154) BLEU: 0 (0.5556/0.125/0/0) ; 0 (0.7143/0.3333/0.2/0) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.5556/0.125/0/0) ; 0 (0.6667/0.4/0.25/0)

Source

��

�O

�@

��

�զ�

��

�֭��]

�C

Ref 0

It's

white

leather

bag.

Ref 1

white

leather

bag.

Ref 2

white

leather

bag

what

is.

Ref 3

The

bag

white

leather.

Ref 4

white

leather

bag.

Ref 5

The

bag

white

and

it's

leather.

Ref 6

white

leather

bag.

Ref 7

bag

that's

white

leather.

Ref 8

It's

bag

done

white

leather.

Ref 9

I've

lost

white

leather

bag.

Ref 10

white

leather

bag.

Ref 11

I'm

looking

for

white

leather

bag.

Ref 12

It's

white

leather

purse.

Ref 13

It's

white

leather

bag.

Ref 14

It's

white

leather

bag.

Ref 15

It's

white

leather

bag.

Output 0

the

leather

white

wrap.

N-grams

It	is	the	leather	in	a	white	to	wrap.
	is		leather	in	a	white
					a white

Output 1

white

leather

package

N-grams

it	is	a	white	leather	package	.
it	is	a	white	leather
		a white
		a white leather
			white leather

Output 2

white

leather

package.

N-grams

It	is	a	white	leather	package.
	is	a	white	leather
		a white
		a white leather
			white leather

Output 3

the

leather

white

wrap.

N-grams

It	is	the	leather	in	a	white	to	wrap.
	is		leather	in	a	white
					a white

Output 4

white

leather

package.

N-grams

It	is	a	white	leather	package.
	is	a	white	leather
		a white
		a white leather
			white leather

Sentence 155) BLEU: 0.9554 (1/1/1/0.8333) ; 0.4518 (0.7/0.5556/0.375/0.2857) ; 0.9554 (1/1/1/0.8333) ; 0.5969 (0.8889/0.75/0.5714/0.3333) ; 0 (0.7/0.4444/0.125/0)

Source

��

�Q

�n

��o

�I��

�M

��

�H

�ƬG

�O�I

�C

Ref 0

I'd

take

out

collision

and

personal

accident

insurance.

Ref 1

I'd

collision

and

personal

accident

insurance

policy.

Ref 2

I'd

collision

and

accident

insurance

policy.

Ref 3

want

collision

and

accident

policy.

Ref 4

I'd

get

some

personal

and

property

insurance.

Ref 5

need

some

personal

and

property

insurance.

Ref 6

want

take

out

personal

and

property

insurance.

Ref 7

want

get

insurance

that

covers

collision

and

personal

liability.

Ref 8

Could

get

collision

and

personal

liability

insurance

please?

Ref 9

want

enroll

for

collision

and

personal

liability

insurance.

Ref 10

want

apply

for

collision

and

personal

accident

insurance.

Ref 11

I'd

have

insurance

that

covers

for

collision

and

personal

accident.

Ref 12

Could

apply

for

insurance

cover

collision

and

personal

accident?

Ref 13

would

get

collision

and

personal

liability

accident

insurance.

Ref 14

would

purchase

collision

and

personal

liability

insurance.

Ref 15

would

get

collision

and

personal

liability

insurance

policy.

Output 0

want

get

collision

and

personal

accident

insurance.

N-grams

I	want	to	get	collision	and	personal	accident	insurance.
I	want	to	get	collision	and	personal	accident	insurance.
I want		to get		collision and		personal accident
I want to			get collision		and personal		accident insurance.
I want to get				collision and personal
	want to		get collision and			personal accident insurance.
	want to get			collision and personal accident
		to get collision			and personal accident
		to get collision and
			get collision and personal
					and personal accident insurance.

Output 1

want

collision

and

personal

accident

insurance

obtain

N-grams

i	want	to	collision	and	personal	accident	insurance	obtain	.
	want	to	collision	and	personal	accident	insurance
	want to		collision and		personal accident
			collision and personal			accident insurance
			collision and personal accident
				and personal
				and personal accident
				and personal accident insurance
					personal accident insurance

Output 2

want

get

collision

and

personal

accident

insurance.

N-grams

I	want	to	get	collision	and	personal	accident	insurance.
I	want	to	get	collision	and	personal	accident	insurance.
I want		to get		collision and		personal accident
I want to			get collision		and personal		accident insurance.
I want to get				collision and personal
	want to		get collision and			personal accident insurance.
	want to get			collision and personal accident
		to get collision			and personal accident
		to get collision and
			get collision and personal
					and personal accident insurance.

Output 3

want

obtain

collision

and

personal

accident

insurance.

N-grams

I	want	to	obtain	collision	and	personal	accident	insurance.
I	want	to		collision	and	personal	accident	insurance.
I want				collision and		personal accident
I want to				collision and personal			accident insurance.
	want to			collision and personal accident
					and personal
					and personal accident
					and personal accident insurance.
						personal accident insurance.

Output 4

want

obtain

the

collision

and

individual

accident

insurance.

N-grams

I	want	to	obtain	the	collision	and	individual	accident	insurance.
I	want	to			collision	and		accident	insurance.
I want					collision and			accident insurance.
I want to
	want to

Sentence 156) BLEU: 1 (1/1/1/1) ; 0 (0.6667/0.5/0/0) ; 1 (1/1/1/1) ; 0 (0.3333/0/0/0) ; 0 (0.5/0.3333/0/0)

Source

�}��

�n

�h�[

�H

Ref 0

How

long

car?

Ref 1

How

long

does

take

car?

Ref 2

How

far

car?

Ref 3

How

much

time

does

take

car?

Ref 4

How

long

will

take

car?

Ref 5

How

long

does

take

automobile?

Ref 6

How

much

time

does

take

drive?

Ref 7

How

long

would

take

car?

Ref 8

car,

how

long

you

estimate

would

take?

Ref 9

How

much

time

does

take

car?

Ref 10

How

long

does

take

car?

Ref 11

How

long

would

take

the

car?

Ref 12

How

much

time

would

take

car?

Ref 13

Long

will

take

drive

there?

Ref 14

How

long

does

take

car?

Ref 15

How

long

does

take

car?

Output 0

How

long

will

take

car?

N-grams

How	long	will	it	take	by	car?
How	long	will	it	take	by	car?
How long		will it		take by
How long will			it take		by car?
How long will it				take by car?
	long will		it take by
	long will it
	long will it take
		will it take
		will it take by
			it take by car?

Output 1

how

long

N-grams

how	long	?
how	long
how long

Output 2

How

long

will

take

car?

N-grams

How	long	will	it	take	by	car?
How	long	will	it	take	by	car?
How long		will it		take by
How long will			it take		by car?
How long will it				take by car?
	long will		it take by
	long will it
	long will it take
		will it take
		will it take by
			it take by car?

Output 3

Drive

how

long?

N-grams

Drive	how	long?
	how

Output 4

How

long

drives

wants?

N-grams

How	long	drives	wants?
How	long
How long

Sentence 157) BLEU: 1 (1/1/1/1) ; 0 (0.25/0/0/0) ; 0 (1/1/1/0) ; 1 (1/1/1/1) ; 0 (0.75/0.3333/0/0)

Source

��

�i�H

�i��

��

�H

Ref 0

May

come

in?

Ref 1

you

mind

come

in?

Ref 2

alright

come

in?

Ref 3

come

in?

Ref 4

come

in?

Ref 5

May

enter?

Ref 6

Can

come

in?

Ref 7

alright

for

come

in?

Ref 8

Can

enter?

Ref 9

entry

permitted?

Ref 10

okay

come

in?

Ref 11

you

mind

come

in?

Ref 12

Can

enter?

Ref 13

May

enter?

Ref 14

May

come

inside?

Ref 15

alright

come

in?

Output 0

Can

come

in?

N-grams

Can	I	come	in?
Can	I	come	in?
Can I		come in?
Can I come
Can I come in?
	I come
	I come in?

Output 1

come

N-grams

i	come	in	?
	come

Output 2

come

in?

N-grams

I	come	in?
I	come	in?
I come
I come in?
	come in?

Output 3

Can

come

in?

N-grams

Can	I	come	in?
Can	I	come	in?
Can I		come in?
Can I come
Can I come in?
	I come
	I come in?

Output 4

may

come

in?

N-grams

I	may	come	in?
I		come	in?
		come in?

Sentence 158) BLEU: 0 (0.8/0.5/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.8/0.5/0/0) ; 0 (0.8/0.25/0/0) ; 0 (1/0.5/0.3333/0)

Source

�O��

�A

��

�C

��

�H

Ref 0

Yes,

there

is.

What's

the

matter?

Ref 1

Yes,

there

is,

but

what's

up?

Ref 2

Yes,

there

is,

but

what's

wrong?

Ref 3

Yes,

there

is,

but

what's

wrong

with

you?

Ref 4

Yes,

there

are.

What's

wrong?

Ref 5

Sure,

there

are.

What's

the

problem?

Ref 6

OK,

have

that.

What

happened?

Ref 7

Yes,

do,

what

can

for

you?

Ref 8

Yes,

there

something

the

matter?

Ref 9

Yes,

there

is,

what

seems

the

problem?

Ref 10

Yes,

have

one.

What

happened?

Ref 11

Yes,

there

one.

What's

wrong?

Ref 12

Yes,

do.

What's

up?

Ref 13

Yes,

available.

What

the

problem?

Ref 14

Yes,

have

them.

What

seems

troubling

you?

Ref 15

Yes,

available.

What

seems

the

problem?

Output 0

Yes,

there

have.

What

happened?

N-grams

Yes,	there	have.	What	happened?
Yes,	there		What	happened?
Yes, there			What happened?

Output 1

yes

there

what

matter

N-grams

yes	,	there	what	matter	?
		there	what

Output 2

Yes,

there

have.

What

happened?

N-grams

Yes,	there	have.	What	happened?
Yes,	there		What	happened?
Yes, there			What happened?

Output 3

Yes,

there

has.

What

matter?

N-grams

Yes,	there	has.	What	matter?
Yes,	there		What	matter?
Yes, there

Output 4

Yes,

there

is.

What

matter?

N-grams

Yes,	there	is.	What	matter?
Yes,	there	is.	What	matter?
Yes, there
Yes, there is.
	there is.

Sentence 159) BLEU: 0 (0.5/0.4/0.25/0) ; 0 (0.6667/0/0/0) ; 0 (1/0.6/0.25/0) ; 0 (0.8333/0.4/0.25/0) ; 0.4889 (0.8571/0.6667/0.4/0.25)

Source

��

�S��

��

�q��

�C

Ref 0

didn't

make

international

call.

Ref 1

didn't

make

overseas

call.

Ref 2

didn't

make

any

international

calls.

Ref 3

didn't

make

international

call.

Ref 4

didn't

dial

any

international

calls.

Ref 5

didn't

call

anyone

overseas.

Ref 6

made

international

phone

calls.

Ref 7

have

not

made

any

international

calls.

Ref 8

did

not

place

any

international

calls.

Ref 9

international

calls

were

made

under

account.

Ref 10

made

international

calls.

Ref 11

didn't

call

overseas.

Ref 12

international

calls.

Ref 13

did

not

call

overseas.

Ref 14

did

not

call

foreign

country.

Ref 15

did

not

call

internationally.

Output 0

didn't

make

International

Telephone

Call.

N-grams

I	didn't	make	International	Telephone	Call.
I	didn't	make
I didn't
I didn't make
	didn't make

Output 1

not

make

international

call

N-grams

i	not	make	international	call	.
	not	make	international	call

Output 2

did

not

make

international

calls.

N-grams

I	did	not	make	international	calls.
I	did	not	make	international	calls.
I did				international calls.
I did not
	did not

Output 3

didn't

make

international

telephone

call.

N-grams

I	didn't	make	international	telephone	call.
I	didn't	make	international		call.
I didn't
I didn't make
	didn't make

Output 4

have

not

made

the

international

call.

N-grams

I	have	not	made	the	international	call.
I	have	not	made		international	call.
I have		not made			international call.
I have not
I have not made
	have not
	have not made

Sentence 160) BLEU: 0 (0.5/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�L

�o

�D�`

�r��

�C

Ref 0

enjoyed

very

much.

Ref 1

had

lot

fun.

Ref 2

enjoyed

lot.

Ref 3

was

lot

fun.

Ref 4

had

super

time.

Ref 5

had

fabulous

time.

Ref 6

thoroughly

enjoyed

myself.

Ref 7

That

was

very

enjoyable.

Ref 8

had

really

good

time.

Ref 9

had

ball.

Ref 10

loved

it.

Ref 11

really

enjoyed

it.

Ref 12

was

great.

Ref 13

was

lot

fun.

Ref 14

had

great

time.

Ref 15

was

pleasure.

Output 0

live

very

happily.

N-grams

I	live	very	happily.
I		very

Output 1

very

happily

N-grams

i	very	happily	.
	very

Output 2

live

very

happily.

N-grams

I	live	very	happily.
I		very

Output 3

lead

very

happily.

N-grams

I	lead	very	happily.
I		very

Output 4

cross

happily.

N-grams

I	cross	happily.
I

Sentence 161) BLEU: 1 (1/1/1/1) ; 0 (0.6/0.5/0/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0 (1/0.5/0/0)

Source

�A

�O

��

�n

��

�C

Ref 0

You

are

the

best.

Ref 1

You

are

the

greatest.

Ref 2

You

are

the

most

wonderful.

Ref 3

You

are

incredible.

Ref 4

You're

the

greatest.

Ref 5

You

are

unparalleled.

Ref 6

You're

tops.

Ref 7

You're

pretty

exceptional.

Ref 8

I'd

say

you're

really

good.

Ref 9

You're

the

best

they

come.

Ref 10

There's

no-one

you.

Ref 11

You're

simply

wonderful.

Ref 12

think

you're

great.

Ref 13

You

are

wonderful.

Ref 14

You

are

number

one.

Ref 15

You

are

the

greatest.

Output 0

You

are

the

best.

N-grams

You	are	the	best.
You	are	the	best.
You are		the best.
You are the
You are the best.
	are the
	are the best.

Output 1

you

are

the

best

N-grams

you	are	the	best	.
	are	the	best
	are the
		the best

Output 2

You

are

the

best.

N-grams

You	are	the	best.
You	are	the	best.
You are		the best.
You are the
You are the best.
	are the
	are the best.

Output 3

You

are

the

best.

N-grams

You	are	the	best.
You	are	the	best.
You are		the best.
You are the
You are the best.
	are the
	are the best.

Output 4

You

are

best.

N-grams

You	are	best.
You	are	best.
You are

Sentence 162) BLEU: 0.4033 (0.8889/0.625/0.2857/0.1667) ; 0 (0.7143/0/0/0) ; 0.4033 (0.8889/0.625/0.2857/0.1667) ; 0 (0.6364/0.3/0.1111/0) ; 0.3782 (0.8182/0.6/0.3333/0.125)

Source

��

�G

�k

�C

��

�Q

�n

�@��

��k��

�C

Ref 0

have

stomachache.

want

some

pain

killers.

Ref 1

I've

got

stomachache

and

I'd

some

medicine

for

it.

Ref 2

Can

have

medicine

for

stomachache?

Ref 3

I'd

some

medicine

for

stomachache.

Ref 4

I'm

having

stomach

pains

could

get

something

for

the

pain?

Ref 5

I'm

feeling

pain

stomach

could

have

some

pain

medication?

Ref 6

stomach

pain

could

have

some

painkillers?

Ref 7

I'd

some

pain

killers

because

stomach

pain.

Ref 8

Could

get

some

pain

killers

for

stomachache?

Ref 9

Please

give

some

medication

stop

stomach

pains.

Ref 10

I've

got

stomachache.

I'd

have

some

pain

killers.

Ref 11

stomach

hurts.

Could

you

get

some

pain

killers?

Ref 12

feel

pain

stomach.

Would

you

mind

giving

some

pain

killers.

Ref 13

have

stomachache.

would

something

for

the

pain.

Ref 14

stomach

hurts.

would

pain

reliever.

Ref 15

have

stomachache.

would

get

some

pain

relievers.

Output 0

have

stomach

pains.

I'd

some

pain

tablets.

N-grams

I	have	stomach	pains.	I'd	like	some	pain	tablets.
I	have	stomach	pains.	I'd	like	some	pain
I have		stomach pains.		I'd like		some pain
				I'd like some
				I'd like some pain
					like some
					like some pain

Output 1

stomach

some

want

N-grams

i	stomach	some	my	want	to	.
	stomach	some	my	want	to

Output 2

have

stomach

pains.

I'd

some

pain

tablets.

N-grams

I	have	stomach	pains.	I'd	like	some	pain	tablets.
I	have	stomach	pains.	I'd	like	some	pain
I have		stomach pains.		I'd like		some pain
				I'd like some
				I'd like some pain
					like some
					like some pain

Output 3

stomach

painful.

want

some

painful

slice.

N-grams

My	stomach	is	painful.	I	want	to	be	some	painful	slice.
My	stomach	is		I	want	to		some
My stomach				I want
My stomach is
	stomach is

Output 4

stomach

hurts.

want

some

stop

hurt

the

piece.

N-grams

My	stomach	hurts.	I	want	some	to	stop	hurt	the	piece.
My	stomach	hurts.	I	want	some	to	stop		the
My stomach		hurts. I		want some		to stop
My stomach hurts.			I want
My stomach hurts. I
	stomach hurts.		I want some
	stomach hurts. I

Sentence 163) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�i�}

��

�C

Ref 0

Spread'em.

Ref 1

Put

your

hands

the

air

and

spread

your

legs.

Ref 2

Legs

apart

and

hands

the

air.

Ref 3

Put

your

hands

the

air

and

spread

your

legs.

Ref 4

Spread

your

arms

and

legs.

Ref 5

Arms

and

legs

wide

out.

Ref 6

Put

your

arms

and

legs

out

wide.

Ref 7

Put

your

hands

and

spread

your

legs.

Ref 8

Hands

and

spread'em.

Ref 9

Put'em

and

spread'em.

Ref 10

Raise

your

arms,

and

spread

your

legs.

Ref 11

Hold

your

hands,

and

spread

out

your

legs.

Ref 12

Put

them

up.

Spread

them.

Ref 13

Spread

out

your

hands

and

legs.

Ref 14

Spread

your

hands

and

feet.

Ref 15

Spread

out

your

hands

and

feet.

Output 0

Launch

grow.

N-grams

Launch

grow.

Output 1

N-grams

Output 2

Expand

governor.

N-grams

Expand

governor.

Output 3

Launch

grow.

N-grams

Launch

grow.

Output 4

Launches

president.

N-grams

Launches

president.

Sentence 164) BLEU: 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.6667/0.5/0/0) ; 0 (0.3333/0/0/0) ; 0.5373 (0.8333/0.6/0.5/0.3333) ; 0 (0.3333/0/0/0)

Source

�ʳf��q

�b

��

�H

Ref 0

Where

the

department

store?

Ref 1

you

know

where

the

department

store

is?

Ref 2

Where

can

find

the

department

store?

Ref 3

Where

the

department

store

located?

Ref 4

Where

would

department

store

be?

Ref 5

Where

would

find

department

store?

Ref 6

Where

would

there

department

store?

Ref 7

Which

way

the

department

store?

Ref 8

Where

would

find

the

department

store?

Ref 9

Where

the

department

store

located?

Ref 10

Could

you

tell

where

the

department

store

is?

Ref 11

The

department

store,

please.

Ref 12

Where

can

find

the

department

store?

Ref 13

Where

department

store?

Ref 14

Where

can

find

department

store?

Ref 15

Where

the

department

store

located?

Output 0

Which

the

department

store?

N-grams

Which	is	the	department	store?
Which	is	the	department	store?
	is the		department store?
	is the department
	is the department store?
		the department
		the department store?

Output 1

department

store

N-grams

department	store	?
department	store
department store

Output 2

Department

store

where?

N-grams

Department	store	where?
	store

Output 3

Which

the

department

store

N-grams

Which	is	the	department	store	?
Which	is	the	department	store
	is the		department store
	is the department
	is the department store
		the department
		the department store

Output 4

Department

store

in?

N-grams

Department	store	in?
	store

Sentence 165) BLEU: 0 (0.6/0/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.6/0/0/0) ; 0 (0.6/0/0/0) ; 0 (0.5/0/0/0)

Source

�A

��w

��

�Ѯv

�H

Ref 0

Which

teacher

you

like?

Ref 1

Who

your

favorite

teacher?

Ref 2

Which

teacher

your

favorite?

Ref 3

Which

your

favorite

teacher?

Ref 4

What

teachers

you

like?

Ref 5

What

teachers

are

your

favorites?

Ref 6

Which

teachers

are

the

ones

you

really

like?

Ref 7

Which

your

favorite

teacher?

Ref 8

Which

teacher

that

you

like?

Ref 9

these

teachers,

who

you

like?

Ref 10

Which

teacher

are

you

keen

on?

Ref 11

Who

one

your

favorite

teachers?

Ref 12

Which

teacher

one

your

favorites?

Ref 13

What

teacher

you

like?

Ref 14

Who

the

teacher

that

you

like?

Ref 15

Who

the

teacher

that

you

prefer?

Output 0

you

that

teacher?

N-grams

Do	you	like	that	teacher?
	you		that	teacher?

Output 1

you

that

teacher

N-grams

do	you	like	that	teacher	?
do	you		that	teacher
do you

Output 2

you

that

teacher?

N-grams

Do	you	like	that	teacher?
	you		that	teacher?

Output 3

you

that

teacher?

N-grams

Do	you	like	that	teacher?
	you		that	teacher?

Output 4

You

that

teacher?

N-grams

You	like	that	teacher?
		that	teacher?

Sentence 166) BLEU: 0 (0.4286/0.3333/0/0) ; 0 (0.5/0.2857/0/0) ; 0 (0.4286/0.3333/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.2857/0/0/0)

Source

��

�y��

��

�H

Ref 0

Would

you

show

seat?

Ref 1

Would

you

take

seat?

Ref 2

Would

you

tell

where

seat

is?

Ref 3

Please

take

seat.

Ref 4

Could

you

take

seat?

Ref 5

Could

you

show

the

way

seat?

Ref 6

Could

you

show

where

seat

is?

Ref 7

you

mind

showing

seat?

Ref 8

Please

take

seat.

Ref 9

Could

you

escort

seat?

Ref 10

Could

you

take

seat?

Ref 11

Would

you

mind

showing

seat?

Ref 12

Please

show

seat.

Ref 13

Please

show

where

sitting?

Ref 14

Could

you

please

show

where

seated?

Ref 15

Could

you

please

guide

seat?

Output 0

Can

refer

seat

for

me?

N-grams

Can	refer	to	my	seat	for	me?
		to	my	seat
		to my
			my seat

Output 1

can

refer

seat

for

N-grams

can	refer	to	my	seat	for	me	?
		to	my	seat		me
		to my
			my seat

Output 2

Can

refer

seat

for

me?

N-grams

Can	refer	to	my	seat	for	me?
		to	my	seat
		to my
			my seat

Output 3

Can

point

seat

me?

N-grams

Can	point	my	seat	to	me?
		my	seat	to
		my seat

Output 4

Can

refer

mine

seat

for

me?

N-grams

Can	refer	to	mine	seat	for	me?
		to		seat

Sentence 167) BLEU: 0.517 (0.625/0.5714/0.5/0.4) ; 0 (0.7143/0.3333/0/0) ; 0 (0.5714/0.1667/0/0) ; 0.517 (0.625/0.5714/0.5/0.4) ; 0 (0.6667/0.125/0/0)

Source

�t�

��

�

�O

�h��

��

�H

Ref 0

How

much

will

with

tax?

Ref 1

How

much

with

tax?

Ref 2

How

much

with

tax

included?

Ref 3

How

much

including

tax?

Ref 4

How

much

does

that

come

with

the

tax?

Ref 5

What

will

that

including

tax?

Ref 6

What

does

that

make

with

the

tax?

Ref 7

Including

tax,

how

much

will

that

cost?

Ref 8

What

will

with

tax?

Ref 9

How

much

going

with

tax

included?

Ref 10

How

much

does

cost

with

tax?

Ref 11

How

much

including

tax?

Ref 12

How

much

does

come

with

tax

included?

Ref 13

After

tax,

how

much

will

cost?

Ref 14

What

the

price

including

tax?

Ref 15

How

much

with

tax

included?

Output 0

Contain

tax,

how

much

will

be?

N-grams

Contain	a	tax,	how	much	will	it	be?
		tax,	how	much	will	it
		tax, how		much will
		tax, how much			will it
		tax, how much will
			how much
			how much will
			how much will it
				much will it

Output 1

tax

how

much

money

N-grams

tax	it	be	how	much	money	?
tax	it	be	how	much
	it be		how much

Output 2

Tax

would

how

much

money?

N-grams

Tax	it	would	be	how	much	money?
	it		be	how	much
				how much

Output 3

Contain

tax,

how

much

will

be?

N-grams

Contain	a	tax,	how	much	will	it	be?
		tax,	how	much	will	it
		tax, how		much will
		tax, how much			will it
		tax, how much will
			how much
			how much will
			how much will it
				much will it

Output 4

How

much

money

including

the

tax

can

be?

N-grams

How	much	money	including	the	tax	can	it	be?
How	much		including	the	tax		it
How much

Sentence 168) BLEU: 0 (1/0.75/0.3333/0) ; 0 (0.8/0.5/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (1/0.75/0.3333/0) ; 0 (0.8/0.5/0/0)

Source

�A

��

�a�K

�a��

��

�H

Ref 0

you

have

subway

map?

Ref 1

you

have

map

the

subway?

Ref 2

you

have

map

the

underground?

Ref 3

you

have

map

showing

the

subway

system?

Ref 4

you

have

map

the

subway

system?

Ref 5

there

subway

map?

Ref 6

you

have

map

with

the

subway

routes?

Ref 7

Are

there

any

subway

maps?

Ref 8

Would

you

have

any

subway

maps?

Ref 9

Where

can

find

subway

map?

Ref 10

you

have

any

subway

maps?

Ref 11

Could

get

subway

map

from

you?

Ref 12

Have

you

got

any

subway

maps?

Ref 13

there

subway

map?

Ref 14

Are

there

any

subway

maps?

Ref 15

you

carry

subway

maps?

Output 0

you

have

subway

map?

N-grams

Do	you	have	subway	map?
Do	you	have	subway	map?
Do you			subway map?
Do you have
	you have

Output 1

you

have

subway

map

N-grams

you	have	subway	map	?
you	have	subway	map
you have		subway map

Output 2

You

have

subway

map?

N-grams

You	have	subway	map?
	have	subway	map?
		subway map?

Output 3

you

have

subway

map?

N-grams

Do	you	have	subway	map?
Do	you	have	subway	map?
Do you			subway map?
Do you have
	you have

Output 4

You

have

the

subway

map?

N-grams

You	have	the	subway	map?
	have	the	subway	map?
		the subway
			subway map?

Sentence 169) BLEU: 1 (1/1/1/1) ; 0 (0.4286/0.3333/0.2/0) ; 0 (1/1/0.6667/0) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.8/0.75/0.3333/0)

Source

��

��U

�A

��

�A

��

�H

Ref 0

May

help

you,

sir?

Ref 1

Can

help

you,

sir?

Ref 2

What

can

for

you,

sir?

Ref 3

there

anything

can

help

you

with,

sir?

Ref 4

Welcome.

Ref 5

Can

help

you?

Ref 6

What

can

for

you?

Ref 7

Hello

there.

Ref 8

there

something

can

help

you

with?

Ref 9

How

are

you

today?

Ref 10

Can

help?

Ref 11

Could

assist

you?

Ref 12

How

may

help

you?

Ref 13

Welcome.

Ref 14

Come

in.

Ref 15

How

may

help

you?

Output 0

Can

help

you,

sir?

N-grams

Can	I	help	you,	sir?
Can	I	help	you,	sir?
Can I		help you,
Can I help			you, sir?
Can I help you,
	I help
	I help you,
	I help you, sir?
		help you, sir?

Output 1

can

help

you

sir

N-grams

i	can	help	you	,	sir	?
	can	help	you
	can help
	can help you
		help you

Output 2

can

help

you,

sir?

N-grams

I	can	help	you,	sir?
I	can	help	you,	sir?
I can		help you,
I can help			you, sir?
	can help
		help you, sir?

Output 3

Can

help

you,

Sir?

N-grams

Can	I	help	you,	Sir?
Can	I	help	you,
Can I		help you,
Can I help
Can I help you,
	I help
	I help you,

Output 4

can

help

you,

gentleman?

N-grams

I	can	help	you,	gentleman?
I	can	help	you,
I can		help you,
I can help
	can help

Sentence 170) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.4/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.5/0.2/0/0)

Source

��

�w

�F

��

�l

�C

Ref 0

have

rash.

Ref 1

rash

has

broken

out

me.

Ref 2

have

got

rash.

Ref 3

I'm

suffering

from

rash.

Ref 4

I'm

getting

rash.

Ref 5

It's

rash.

Ref 6

I've

got

rash.

Ref 7

I've

developed

rash.

Ref 8

I've

gotten

rash.

Ref 9

I've

broken

out.

Ref 10

I've

got

rash.

Ref 11

I've

come

out

rash.

Ref 12

rash

has

broken

out

skin.

Ref 13

experiencing

rash.

Ref 14

breaking

out.

Ref 15

breaking

out

hives.

Output 0

had

rash.

N-grams

I	had	a	rash.
I		a	rash.
		a rash.

Output 1

rash

skin

N-grams

i	a	rash	skin	.
	a	rash

Output 2

had

rash.

N-grams

I	had	a	rash.
I		a	rash.
		a rash.

Output 3

suffered

from

skin

rash.

N-grams

I	suffered	from	a	skin	rash.
I		from	a		rash.
		from a

Output 4

have

contracted

the

skin

rash.

N-grams

I	have	contracted	the	skin	rash.
I	have				rash.
I have

Sentence 171) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�S��Y

�C

Ref 0

That's

all

right.

Ref 1

That's

OK.

Ref 2

problem.

Ref 3

worries.

Ref 4

That's

OK.

Ref 5

Don't

worry

about

it.

Ref 6

That's

fine.

Ref 7

It's

okay.

Ref 8

Don't

worry

about

it.

Ref 9

It's

problem.

Ref 10

That's

okay.

Ref 11

It's

fine.

Ref 12

problem.

Ref 13

That's

okay.

Ref 14

It's

fine.

Ref 15

It's

problem.

Output 0

doesn't

matter.

N-grams

doesn't

matter.

Output 1

N-grams

Output 2

沒關係.

N-grams

沒關係.

Output 3

doesn't

matter.

N-grams

doesn't

matter.

Output 4

Has

not

related.

N-grams

Has

not

related.

Sentence 172) BLEU: 0 (0.6667/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.75/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.75/0/0/0)

Source

��

�O�o

�F

�C

Ref 0

don't

remember.

Ref 1

don't

recall.

Ref 2

can't

remember.

Ref 3

can't

recall.

Ref 4

can't

remember.

Ref 5

can't

recall.

Ref 6

I'm

not

able

remember.

Ref 7

have

recollection.

Ref 8

don't

recall.

Ref 9

I'm

not

sure.

Ref 10

can't

remember.

Ref 11

have

memory

that.

Ref 12

I've	forgotten.

Ref 13

don't

recall.

Ref 14

don't

have

memory

it.

Ref 15

It's

not

memory.

Output 0

didn't

remember.

N-grams

I	didn't	remember.
I		remember.

Output 1

not

remember

N-grams

i	not	remember	.
	not

Output 2

can

not

remember.

N-grams

I	can	not	remember.
I		not	remember.

Output 3

didn't

remember.

N-grams

I	didn't	remember.
I		remember.

Output 4

not

remember.

N-grams

I	do	not	remember.
I		not	remember.

Sentence 173) BLEU: 0 (1/1/0/0) ; 0 (0.3333/0/0/0) ; 0 (1/1/0/0) ; 0 (1/1/0/0) ; 0 (1/0/0/0)

Source

��

�A

�C

Ref 0

Thank

you.

Ref 1

Thanks.

Ref 2

Thanks.

Ref 3

Thanks

lot.

Ref 4

Thanks

much.

Ref 5

Thanks.

Ref 6

appreciate

it.

Ref 7

Thanks

lot.

Ref 8

Thanks.

Ref 9

Wonderful.

Ref 10

Thanks

for

your

help.

Ref 11

Thank

you

very

much.

Ref 12

Thanks.

Ref 13

My	gratitude.

Ref 14

Thank

you.

Ref 15

Thank

you.

Output 0

Thank

you.

N-grams

Thank	you.
Thank	you.
Thank you.

Output 1

thank

you

N-grams

thank	you	.
	you

Output 2

Thank

you.

N-grams

Thank	you.
Thank	you.
Thank you.

Output 3

Thank

you.

N-grams

Thank	you.
Thank	you.
Thank you.

Output 4

Thanks

you.

N-grams

Thanks	you.
Thanks	you.

Sentence 174) BLEU: 0 (0.5/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.25/0/0/0)

Source

�O��

�C

��

�b

�o��

�C

Ref 0

Yes.

Here

is.

Ref 1

Yes.

Here

you

go.

Ref 2

Yes.

Here

you

are.

Ref 3

Yes.

Here.

Ref 4

Sure.

Here.

Ref 5

OK.

Please.

Ref 6

Yeah.

Here

you

go.

Ref 7

course.

Here.

Ref 8

Sure.

This

it.

Ref 9

Certainly.

Here

you

go.

Ref 10

Alright.

Here

you

go.

Ref 11

Fine.

Help

yourself.

Ref 12

Okay.

Here

you

are.

Ref 13

Yes.

Here

you

are.

Ref 14

Yes.

Here

you

go.

Ref 15

Yes.

There

you

go.

Output 0

Yes.

here.

N-grams

Yes.	It	is	here.
Yes.		is

Output 1

yes

here

N-grams

yes	it	here	.
	it

Output 2

Yes.

here.

N-grams

Yes.	It	here.
Yes.

Output 3

Yes.

here.

N-grams

Yes.	It	is	here.
Yes.		is

Output 4

Yes.

here.

N-grams

Yes.	It	in	here.
Yes.

Sentence 175) BLEU: 0 (0.5/0.4/0.25/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0.4/0.25/0)

Source

�˰t

��

�b

��

�H

Ref 0

Where's

the

fitting

room?

Ref 1

Where

the

changing

room?

Ref 2

Where

can

find

the

fitting

room?

Ref 3

Where

the

fitting

room

located?

Ref 4

Where

would

the

fitting

room

be?

Ref 5

Where's

the

room

for

trying

things

on?

Ref 6

Where

would

find

the

fitting

room?

Ref 7

Please

tell

where

the

fitting

room

is.

Ref 8

Could

you

direct

the

fitting

room?

Ref 9

Whereabouts

the

fitting

room?

Ref 10

Could

you

show

the

fitting

room?

Ref 11

Can

you

tell

where

the

fitting

room

is?

Ref 12

Please

show

the

way

the

fitting

room.

Ref 13

Where

can

try

this

on?

Ref 14

Where

the

change

room?

Ref 15

Where

room

where

can

try

this

on?

Output 0

Where

the

assembly

shop

at?

N-grams

Where	is	the	assembly	shop	at?
Where	is	the
Where is
Where is the
	is the

Output 1

assembly

shop

where

N-grams

assembly	shop	where	?
		where

Output 2

Assembly

shop

where?

N-grams

Assembly

shop

where?

Output 3

Assemble

car

where?

N-grams

Assemble	a	car	where?
	a

Output 4

Where

the

Assembly

shop

at?

N-grams

Where	is	the	Assembly	shop	at?
Where	is	the
Where is
Where is the
	is the

Sentence 176) BLEU: 0 (0.875/0.2857/0/0) ; 0 (0.75/0.2857/0.1667/0) ; 0 (0.8571/0.3333/0.2/0) ; 0 (0.875/0.2857/0/0) ; 0 (0.7778/0.25/0/0)

Source

��

�{��

�o��

�q�v

��

�C

Ref 0

didn't

think

this

movie

was

very

interesting.

Ref 1

didn't

think

this

movie

was

good.

Ref 2

didn't

think

this

movie

was

all

that

interesting.

Ref 3

This

movie

wasn't

very

interesting

opinion.

Ref 4

This

movie

wasn't

very

good.

Ref 5

This

movie

wasn't

very

entertaining.

Ref 6

This

film

wasn't

good.

Ref 7

This

movie

wasn't

really

that

interesting.

Ref 8

didn't

really

enjoy

this

movie.

Ref 9

didn't

find

this

movie

very

entertaining.

Ref 10

This

movie

was

really

dull.

Ref 11

This

was

really

boring

movie.

Ref 12

thought

was

quite

boring

film.

Ref 13

This

movie

was

not

very

interesting.

Ref 14

This

movie

was

bit

boring.

Ref 15

This

movie

was

bit

bore.

Output 0

think

that

this

movie

isn't

that

interesting.

N-grams

I	think	that	this	movie	isn't	that	interesting.
I	think	that	this	movie		that interesting.
			this movie				interesting.

Output 1

not

think

this

movie

interesting

that

N-grams

i	not	think	this	movie	interesting	that	.
	not	think	this	movie	interesting	that
		think this
		think this movie
			this movie

Output 2

not

think

this

movie

interesting.

N-grams

I	do	not	think	this	movie	interesting.
I		not	think	this	movie	interesting.
			think this
			think this movie
				this movie

Output 3

think

that

this

movie

isn't

that

interesting.

N-grams

I	think	that	this	movie	isn't	that	interesting.
I	think	that	this	movie		that interesting.
			this movie				interesting.

Output 4

thought

that

this

movie

not

too

interesting.

N-grams

I	thought	that	this	movie	is	not	too	interesting.
I	thought	that	this	movie		not		interesting.
I thought			this movie

Sentence 177) BLEU: 0 (1/1/0/0) ; 0 (0.3333/0/0/0) ; 0 (1/1/0/0) ; 0 (1/1/0/0) ; 0 (0.5/0/0/0)

Source

�h��

�H

Ref 0

How

much?

Ref 1

How

much

it?

Ref 2

How

much

does

cost?

Ref 3

What

the

price?

Ref 4

How

much

it?

Ref 5

How

much

will

be?

Ref 6

How

much

does

cost?

Ref 7

How

much

does

cost?

Ref 8

What's

the

cost?

Ref 9

What's

the

fare?

Ref 10

How

much

it?

Ref 11

How

much

does

cost?

Ref 12

What

does

cost?

Ref 13

How

much

it?

Ref 14

What's

the

price?

Ref 15

How

much

does

cost?

Output 0

How

much?

N-grams

How	much?
How	much?
How much?

Output 1

how

much

N-grams

how	much	?
	much

Output 2

How

much?

N-grams

How	much?
How	much?
How much?

Output 3

How

much?

N-grams

How	much?
How	much?
How much?

Output 4

How

many?

N-grams

How	many?
How

Sentence 178) BLEU: 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.1667/0/0/0)

Source

�

��

��s

�F

�C

Ref 0

Hold

the

onions.

Ref 1

onions,

please.

Ref 2

onions.

Ref 3

don't

want

any

onions

mine.

Ref 4

onions.

Ref 5

Don't

add

any

onions.

Ref 6

Don't

put

any

onions

it.

Ref 7

onions,

please.

Ref 8

don't

want

any

onions,

please.

Ref 9

Don't

add

any

onions,

please.

Ref 10

Don't

put

onions

in.

Ref 11

onions.

Ref 12

Take

off

the

onions.

Ref 13

Please

not

put

any

onions

it.

Ref 14

onions,

please.

Ref 15

Please

leave

out

the

onions.

Output 0

Keep

the

change

zero.

N-grams

Keep	the	change	zero.
	the

Output 1

not

give

change

N-grams

not	give	change	.
not

Output 2

not

give

change

N-grams

Do	not	give	change	a.
	not

Output 3

Keep

the

change

zero.

N-grams

Keep	the	change	zero.
	the

Output 4

Did

not

need

give

change.

N-grams

Did	not	need	to	give	change.
	not

Sentence 179) BLEU: 0 (0.625/0.1429/0/0) ; 0 (0.25/0/0/0) ; 0 (0.8/0.5/0/0) ; 0 (0.625/0.1429/0/0) ; 0 (0.2857/0/0/0)

Source

��

��~

��q

��

�ӷP��

�ֽ�

�H

Ref 0

What

kinds

products

are

good

for

sensitive

skin?

Ref 1

What

products

are

safe

for

sensitive

skin?

Ref 2

Which

products

are

good

for

sensitive

skin?

Ref 3

Which

products

are

alright

use

sensitive

skin?

Ref 4

For

sensitive

skin,

what

kind

products

can

you

recommend?

Ref 5

For

sensitive

skin,

what

sorts

products

would

good?

Ref 6

What

types

products

would

work

for

sensitive

skin?

Ref 7

What

products

would

you

recommend

for

sensitive

skin?

Ref 8

it's

for

sensitive

skin,

which

products

would

you

recommend?

Ref 9

What

are

products

recommended

for

sensitive

skin?

Ref 10

Which

products

suit

sensitive

skin?

Ref 11

Which

products

are

suitable

for

sensitive

skin?

Ref 12

What

products

are

okay

with

sensitive

skin?

Ref 13

What

products

are

good

for

sensitive

skin?

Ref 14

Which

products

are

good

for

sensitive

skin?

Ref 15

Which

products

you

recommend

for

sensitive

skin?

Output 0

Which

product

good

for

sensitivity

skin?

N-grams

Which	product	be	good	for	a	sensitivity	skin?
Which		be	good	for			skin?
			good for

Output 1

which

skin

product

N-grams

which	skin	product	?
which

Output 2

Which

products

benefit

sensitive

skin?

N-grams

Which	products	benefit	sensitive	skin?
Which	products		sensitive	skin?
Which products			sensitive skin?

Output 3

Which

product

good

for

sensitivity

skin?

N-grams

Which	product	be	good	for	a	sensitivity	skin?
Which		be	good	for			skin?
			good for

Output 4

Which

product

beneficial

Min

perceptual

skin?

N-grams

Which	product	beneficial	Yu	Min	perceptual	skin?
Which						skin?

Sentence 180) BLEU: 0 (0.8/0.75/0.3333/0) ; 0 (0.75/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.8/0.75/0.3333/0) ; 0 (0.4/0/0/0)

Source

�u

�ݭn

��

�o��

�C

Ref 0

Just

press

this.

Ref 1

Just

press

this

button.

Ref 2

Just

push

this

button.

Ref 3

All

you

have

press

this.

Ref 4

Just

push

this.

Ref 5

Just

press

down

this.

Ref 6

All

you

have

press

this.

Ref 7

Simply

press

right

here.

Ref 8

All

you

need

press

here.

Ref 9

You

just

press

here.

Ref 10

Just

push

here.

Ref 11

All

you

need

press

here.

Ref 12

You

just

need

press

here.

Ref 13

You

only

have

press

here.

Ref 14

Just

push

this

button.

Ref 15

Just

depress

here.

Output 0

Only

need

press

this.

N-grams

Only	need	to	press	this.
	need	to	press	this.
	need to		press this.
	need to press
		to press

Output 1

only

this

N-grams

only	this	to	.
only	this	to

Output 2

Only

accordance

with

this.

N-grams

Only	in	accordance	with	this.
				this.

Output 3

Only

need

press

this.

N-grams

Only	need	to	press	this.
	need	to	press	this.
	need to		press this.
	need to press
		to press

Output 4

Only

needs

according

this.

N-grams

Only	needs	according	to	this.
			to	this.

Sentence 181) BLEU: 0.5373 (0.8333/0.6/0.5/0.3333) ; 0 (0.6/0.25/0/0) ; 1 (1/1/1/1) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.3333/0/0/0)

Source

�A��

��

�]�N

�аO

��

�H

Ref 0

you

have

magic

marker?

Ref 1

there

magic

marker?

Ref 2

you

have

marker?

Ref 3

Have

you

got

magic

marker?

Ref 4

you

have

highlighter?

Ref 5

Would

you

have

highlighter?

Ref 6

Would

you

have

felt

marker?

Ref 7

you

have

marker

you?

Ref 8

Have

you

marker?

Ref 9

Have

you

got

any

magic

markers?

Ref 10

Could

you

get

magic

marker?

Ref 11

need

magic

marker.

Ref 12

you

have

felt

pen?

Ref 13

there

felt

pen?

Ref 14

Are

there

any

felt

pens

around?

Ref 15

you

have

magic

marker?

Output 0

you

have

Magic

marker?

N-grams

Do	you	have	a	Magic	marker?
Do	you	have	a		marker?
Do you		have a
Do you have
Do you have a
	you have
	you have a

Output 1

you

have

magic

N-grams

do	you	have	magic	?
	you	have	magic
	you have

Output 2

you

have

magic

marker?

N-grams

Do	you	have	a	magic	marker?
Do	you	have	a	magic	marker?
Do you		have a		magic marker?
Do you have			a magic
Do you have a
	you have		a magic marker?
	you have a
	you have a magic
		have a magic
		have a magic marker?

Output 3

you

have

magic

marking?

N-grams

Do	you	have	magic	marking?
Do	you	have	magic
Do you
Do you have
	you have

Output 4

You

have

the

magic

mark?

N-grams

You	have	the	magic	to	mark?
	have		magic

Sentence 182) BLEU: 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0) ; 0 (0/0/0/0)

Source

��

�C

Ref 0

Hello.

Ref 1

Hi.

Ref 2

Howdy.

Ref 3

Greetings.

Ref 4

Good	afternoon.

Ref 5

Hi.

Ref 6

Greetings.

Ref 7

Howdy.

Ref 8

Yo.

Ref 9

Hey

there.

Ref 10

Hi.

Ref 11

there.

Ref 12

Good	afternoon.

Ref 13

Good	afternoon.

Ref 14

Good

day.

Ref 15

Hello.

Output 0

Hello.

N-grams

Hello.

Output 1

N-grams

Output 2

餵.

N-grams

餵.

Output 3

Hello.

N-grams

Hello.

Output 4

Feeding.

N-grams

Feeding.

Sentence 183) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5714/0.3333/0/0)

Source

�A��

��

�ֽ�

��

�F��

��

�H

Ref 0

you

have

something

cotton?

Ref 1

you

have

one

that

cotton?

Ref 2

you

have

one

made

out

cotton?

Ref 3

you

have

any

cotton?

Ref 4

Would

you

have

anything

made

cotton?

Ref 5

you

carry

cotton

items?

Ref 6

you

have

something

made

with

cotton

material?

Ref 7

there

something

cotton?

Ref 8

Would

there

something

available

cotton?

Ref 9

Have

you

anything

cotton?

Ref 10

Have

you

got

anything

cotton?

Ref 11

Could

you

show

something

cotton?

Ref 12

I'm

looking

for

something

cotton.

Ref 13

there

anything

made

from

cotton?

Ref 14

you

carry

anything

cotton?

Ref 15

you

have

anything

made

from

cotton?

Output 0

What

you

have

cotton

anything?

N-grams

What	you	have	cotton	anything?
	you	have	cotton
	you have

Output 1

what

you

have

cotton

N-grams

what	you	have	cotton	?
	you	have	cotton
	you have

Output 2

What

you

have

cotton

anything?

N-grams

What	you	have	cotton	anything?
	you	have	cotton
	you have

Output 3

You

have

cotton

quality

what?

N-grams

You	have	cotton	quality	of	what?
	have	cotton		of

Output 4

What

thing

you

have

cotton

material?

N-grams

What	thing	do	you	have	cotton	material?
			you	have	cotton	material?
			you have		cotton material?

Sentence 184) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.5/0.2/0/0) ; 0 (0.5/0.2/0/0)

Source

�A

�ǳ�

�I��

�F

��

�H

Ref 0

Are

you

ready

order?

Ref 1

Have

you

decided?

Ref 2

Are

you

ready

make

your

order?

Ref 3

Can

take

your

order

now?

Ref 4

Would

you

order

now?

Ref 5

Have

you

decided?

Ref 6

you

know

what

you

want

order?

Ref 7

Have

you

decided

what

you'd

like?

Ref 8

Would

you

ready

order

now?

Ref 9

What

have

you

decided

on?

Ref 10

Can

take

your

order?

Ref 11

Have

you

decided

what

have?

Ref 12

Have

you

decided

your

order?

Ref 13

Have

you

decided

what

you

want

order?

Ref 14

Are

you

ready

make

order?

Ref 15

Have

you

decided?

Output 0

You

ready

order?

N-grams

You	ready	to	order?
	ready	to	order?
	ready to
	ready to order?
		to order?

Output 1

you

order

N-grams

you	to	order	?
you	to	order
	to order

Output 2

You

ready

order?

N-grams

You	ready	to	order?
	ready	to	order?
	ready to
	ready to order?
		to order?

Output 3

Did

you

prepare

order

vegetables?

N-grams

Did	you	prepare	to	order	vegetables?
	you		to	order
			to order

Output 4

You

have

prepared

order

food?

N-grams

You	have	prepared	to	order	food?
	have		to	order
			to order

Sentence 185) BLEU: 1 (1/1/1/1) ; 0 (0.6/0.25/0/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0 (0.8/0.5/0.3333/0)

Source

��

�F

��

�}��

�C

Ref 0

sprained

ankle.

Ref 1

I've

got

sprained

ankle.

Ref 2

ankle

sprained.

Ref 3

twisted

ankle.

Ref 4

I've

got

sprained

ankle.

Ref 5

twisted

foot.

Ref 6

I've

sprained

ankle.

Ref 7

ankle

sprained.

Ref 8

I've

twisted

ankle.

Ref 9

I've

twisted

ankle.

Ref 10

went

over

ankle.

Ref 11

ankle

sprained.

Ref 12

I've

rolled

over

ankle.

Ref 13

I've

twisted

ankle.

Ref 14

hurt

ankle.

Ref 15

sprained

ankle.

Output 0

sprained

ankle.

N-grams

I	sprained	my	ankle.
I	sprained	my	ankle.
I sprained		my ankle.
I sprained my
I sprained my ankle.
	sprained my
	sprained my ankle.

Output 1

sprained

ankle

N-grams

i	sprained	my	ankle	.
	sprained	my	ankle
	sprained my

Output 2

sprained

ankle.

N-grams

I	sprained	my	ankle.
I	sprained	my	ankle.
I sprained		my ankle.
I sprained my
I sprained my ankle.
	sprained my
	sprained my ankle.

Output 3

sprained

ankle.

N-grams

I	sprained	my	ankle.
I	sprained	my	ankle.
I sprained		my ankle.
I sprained my
I sprained my ankle.
	sprained my
	sprained my ankle.

Output 4

sprained

ankle

area.

N-grams

I	sprained	my	ankle	area.
I	sprained	my	ankle
I sprained
I sprained my
	sprained my

Sentence 186) BLEU: 0 (0.2857/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2857/0.1667/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.2/0/0/0)

Source

��

�@

�p

��

�C

Ref 0

Small

and

medium,

please.

Ref 1

Please

give

small

and

medium.

Ref 2

small

and

medium

please.

Ref 3

One

small,

one

medium

please.

Ref 4

Please

give

one

small

and

one

medium.

Ref 5

Please

bring

small

one

and

medium

one.

Ref 6

We'd

one

small

size

and

one

medium

size,

please.

Ref 7

I'd

one

small

and

one

medium,

please.

Ref 8

Could

you

give

small

and

medium,

please?

Ref 9

Please

make

small

and

medium.

Ref 10

Make

that

small

and

medium.

Ref 11

I'd

small

and

medium.

Ref 12

small

and

medium

size

for

me,

thanks.

Ref 13

small

and

medium

size,

please.

Ref 14

would

one

small

and

one

medium,

please.

Ref 15

small

and

medium,

please.

Output 0

Please

bit

five

maturities.

N-grams

Please	to	a	bit	of	five	maturities.
Please		a

Output 1

five

N-grams

a	of	five	.
a

Output 2

Invited

small

piece

ripe

Friday.

N-grams

Invited	a	small	piece	of	ripe	Friday.
	a	small
	a small

Output 3

Please

bit

five

maturities.

N-grams

Please	to	a	bit	of	five	maturities.
Please		a

Output 4

Invites

scrap

maturely

five.

N-grams

Invites	a	scrap	maturely	five.
	a

Sentence 187) BLEU: 0.2694 (0.8/0.4167/0.1739/0.09091) ; 0.2083 (0.8333/0.3478/0.1364/0.04762) ; 0.2694 (0.8/0.4167/0.1739/0.09091) ; 0 (0.7333/0.2069/0.1071/0) ; 0 (0.6538/0.32/0.08333/0)

Source

��

�O

��

�Ѯ�

��

�Q��

�C

�o

�Q

��

�N��

�O

�p�G

�A

��w

�ڭ�

�i�H

��

�U��

��

�@�
��

�C

Ref 0

That

was

not

discussion

about

weather.

What

she

meant

say

was

you

can

stop

and

chat

for

while.

Ref 1

That

wasn't

talk

about

the

weather,

she

just

wanted

let

you

know

that

you

could

stop

and

chat

for

while

you

wanted

to.

Ref 2

That

wasn't

chat

about

the

weather,

she

just

meant

say

that

you

could

stop

and

chat

longer

you

wanted

to.

Ref 3

She

wasn't

talking

about

the

weather,

she

was

giving

you

opportunity

stay

and

talk

for

while.

Ref 4

That

exchange

was

not

about

the

weather.

What

she

was

trying

say

was

that

could

have

chat.

Ref 5

That

discussion

was

not

about

the

weather.

Her

meaning

was

that

you

want

to,

can

have

chitchat.

Ref 6

That

exchange

had

nothing

with

weather.

She

meant

that

you'd

interested,

could

have

talk.

Ref 7

That

wasn't

simply

discussion

about

the

weather,

she

was

trying

say

she

was

available

stop

and

chat

for

while.

Ref 8

She

wasn't

just

talking

about

the

weather;

she

wanted

say

that

she'd

chat

for

while

with

you.

Ref 9

wasn't

just

discussion

about

the

weather;

she

wanted

let

you

know

that

she

wanted

chat

for

while.

Ref 10

She

didn't

mean

talk

about

the

weather.

She

just

meant

that

was

okay

chat

bit.

Ref 11

You

weren't

discussing

the

weather.

She

was

just

giving

you

sign

that

she

didn't

mind

talking

for

bit.

Ref 12

It's

not

that

she

wanted

discuss

the

weather.

She

just

wanted

stop

and

chat

for

while.

Ref 13

was

not

about

the

weather.

What

was

meant

was,

you

would

like,

can

pause

and

chat

for

bit.

Ref 14

were

not

talking

about

the

weather.

The

meaning

was,

you

like,

can

talk

for

bit.

Ref 15

That

was

not

about

the

weather.

What

was

meant

was

that

can

talk

for

while

want

to.

Output 0

was

not

about

the

weather

discussion.

She

would

say

yes

you

mean

can

enjoy

moment

stop

and

chat.

N-grams

was

not

about

the

weather

discussion.

She

would

say

yes

you

mean

can

enjoy

moment

stop

and

chat.

was

not

about

the

She

would

say

you

mean

can

stop

and

chat.

It was

not about

like to

if you

we can

to stop

It was not

about the

to say

to stop and

It was not about

stop and

was not

was not about

was not about the

not about the

Output 1

not

about

the

weather

discussion

she

say

you

can

stop

and

chat

that

the

meaning

while

N-grams

not

about

the

weather

discussion

she

say

you

can

stop

and

chat

that

the

meaning

while

not

about

the

discussion

she

say

you

can

stop

and

chat

that

meaning

while

not about

like to

if you

to stop

and chat

not about the

to say

to stop and

about the

to stop and chat

stop and

stop and chat

Output 2

was

not

about

the

weather

discussion.

She

would

say

yes

you

mean

can

enjoy

moment

stop

and

chat.

N-grams

was

not

about

the

weather

discussion.

She

would

say

yes

you

mean

can

enjoy

moment

stop

and

chat.

was

not

about

the

She

would

say

you

mean

can

stop

and

chat.

It was

not about

like to

if you

we can

to stop

It was not

about the

to say

to stop and

It was not about

stop and

was not

was not about

was not about the

not about the

Output 3

That

isn't

the

discussion

concerning

the

weather.

Her

meanings

for

meaning

say

short

while

you

and

can

come

stop

chat.

N-grams

That

isn't

the

discussion

concerning

the

weather.

Her

meanings

for

meaning

say

short

while

you

and

can

come

stop

chat.

That

the

discussion

the weather.

Her

for

meaning

say

while

you

and

can

stop

chat.

the weather. Her

to say

while if

you like

weather.

while if you

weather. Her

if you

if you like

Output 4

That

not

about

the

weather

discussion.

She

wants

say

the

meaning

you

being

possible

stop

down

chat

while.

N-grams

That

not

about

the

weather

discussion.

She

wants

say

the

meaning

you

being

possible

stop

down

chat

while.

That

not

about

the

She

say

meaning

you

stop

chat

while.

not about

to say

if you

to stop

chat a

not about the

if you like

a while.

about the

you like

Sentence 188) BLEU: 0 (0.3333/0/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.4286/0.3333/0.2/0) ; 0 (0.4286/0.3333/0.2/0)

Source

�s��

��

�b

��

�H

Ref 0

Where

the

liquor

department?

Ref 1

Where

liquor

sold?

Ref 2

Where

the

liquor

section?

Ref 3

Where

can

find

the

liquor

section?

Ref 4

Where

the

place

they

sell

liquor?

Ref 5

Where's

the

liquor

corner?

Ref 6

Where's

the

liquor

section?

Ref 7

Could

you

tell

where

the

liquor

section

is?

Ref 8

Where's

the

liquor

section

located?

Ref 9

Where

can

find

your

liquor

section?

Ref 10

Where's

the

liquor

section?

Ref 11

Where

can

find

the

place

that

sells

liquor?

Ref 12

Where

can

buy

liquor?

Ref 13

Where

the

liquor

store?

Ref 14

Where

liquor

sold?

Ref 15

Where

may

find

liquor

outlet?

Output 0

Where

the

department

alcoholic

beverages?

N-grams

Where	the	department	of	alcoholic	beverages?
Where	the

Output 1

where

the

department

alcoholic

beverage

N-grams

where	the	department	alcoholic	is	beverage	?
where	the			is
where the

Output 2

Where

the

Department

Alcoholic

Beverages?

N-grams

Where	the	Department	of	Alcoholic	Beverages?
Where	the

Output 3

Where

the

alcohol

beverage

department

N-grams

Where	is	the	alcohol	beverage	department	?
Where	is	the
Where is
Where is the
	is the

Output 4

Where

the

alcoholic

beverage

department

at?

N-grams

Where	is	the	alcoholic	beverage	department	at?
Where	is	the
Where is
Where is the
	is the

Sentence 189) BLEU: 0 (0.8571/0.5/0.2/0) ; 0 (0.6667/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.8571/0.5/0.2/0) ; 0 (0.5/0.2/0/0)

Source

�o

��

�

��

�X�o

��

�H

Ref 0

Will

this

train

leave

time?

Ref 1

Will

this

train

leave

schedule?

Ref 2

Will

this

train

depart

time?

Ref 3

Will

this

train

leave

according

schedule?

Ref 4

Will

this

train

depart

time?

Ref 5

Will

this

train

leaving

scheduled?

Ref 6

this

train

going

taking

off

time?

Ref 7

this

train

leaving

schedule?

Ref 8

Will

the

train

leave

scheduled?

Ref 9

the

train

going

depart

schedule?

Ref 10

this

train

going

leave

time?

Ref 11

Will

this

train's

departure

schedule?

Ref 12

this

train

due

leave

the

set

time

Ref 13

Does

this

train

leave

time?

Ref 14

Will

this

train

leave

scheduled?

Ref 15

Will

this

train

leave

the

correct

time?

Output 0

Will

this

train

set

out

time?

N-grams

Will	this	train	set	out	on	time?
Will	this	train	set		on	time?
Will this					on time?
Will this train
	this train

Output 1

train

time

will

this

N-grams

train	on	time	will	this	?
train	on	time		this

Output 2

The

purpose

his

train

time

starting

it?

N-grams

The	purpose	of	his	train	on	time	starting	it?
				train	on	time

Output 3

Will

this

train

set

out

time?

N-grams

Will	this	train	set	out	on	time?
Will	this	train	set		on	time?
Will this					on time?
Will this train
	this train

Output 4

This

train

will

embark

time?

N-grams

This	train	will	embark	on	time?
	train			on	time?
				on time?

Sentence 190) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.5/0.2/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.4/0/0/0) ; 0 (0.8333/0.6/0.25/0)

Source

�A

�p��

�}�l

�u�@

��

�H

Ref 0

How

you

get

work?

Ref 1

How

you

commute

work?

Ref 2

How

you

work?

Ref 3

What

you

use

get

work?

Ref 4

What

you

take

get

work?

Ref 5

How

you

commute

work?

Ref 6

How

you

get

and

from

your

job?

Ref 7

How

you

commute?

Ref 8

Which

method

you

commute

by?

Ref 9

How

you

travel

and

from

work?

Ref 10

What

you

use

get

work?

Ref 11

Which

way

you

work?

Ref 12

Which

route

you

take

work?

Ref 13

How

you

commute

work?

Ref 14

What

usually

work

by?

Ref 15

What

you

take

work?

Output 0

How

you

start

work?

N-grams

How	do	you	start	work?
How	do	you		work?
How do
How do you
	do you

Output 1

how

you

start

work

N-grams

how	do	you	start	work	?
	do	you		work
	do you

Output 2

How

you

start

work?

N-grams

How	do	you	start	work?
How	do	you		work?
How do
How do you
	do you

Output 3

How

did

you

start

working?

N-grams

How	did	you	start	working?
How		you

Output 4

How

you

start

work?

N-grams

How	do	you	start	to	work?
How	do	you		to	work?
How do				to work?
How do you
	do you

Sentence 191) BLEU: 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.5714/0.3333/0.2/0) ; 0.7598 (0.8333/0.8/0.75/0.6667) ; 0.4111 (0.5714/0.5/0.4/0.25) ; 0 (0.5/0.2857/0.1667/0)

Source

��

�y�츹

�O

��

�Q

��

�C

Ref 0

seat

number

fifteen.

Ref 1

seat

fifteen.

Ref 2

I'm

fifteen.

Ref 3

fifteen

seat.

Ref 4

I'm

seat

fifteen.

Ref 5

I'm

seated

one-five.

Ref 6

I'm

sitting

fifteen.

Ref 7

I'm

fifteen.

Ref 8

I'm

seated

fifteen.

Ref 9

seat

location

fifteen.

Ref 10

I'm

sitting

fifteen.

Ref 11

I'm

fifteen.

Ref 12

I'm

seated

fifteen.

Ref 13

seat

fifteen.

Ref 14

seat

fifteen.

Ref 15

seated

number

fifteen.

Output 0

seat

number

15.

N-grams

My	seat	number	is	a	15.
My	seat	number	is
My seat		number is
My seat number
My seat number is
	seat number
	seat number is

Output 1

seat

number

N-grams

my	seat	number	is	a	15	.
my	seat	number	is
	seat number
	seat number is
		number is

Output 2

seat

number

15.

N-grams

My	seat	number	is	A	15.
My	seat	number	is	A
My seat		number is
My seat number			is A
My seat number is
	seat number
	seat number is
	seat number is A
		number is A

Output 3

seat

number

��

15.

N-grams

My	seat	number	is	a	��	15.
My	seat	number	is
My seat		number is
My seat number
My seat number is
	seat number
	seat number is

Output 4

place

position

number

ten

five.

N-grams

My	place	position	number	is	A	ten	five.
My			number	is	A
			number is
			number is A
				is A

Sentence 192) BLEU: 1 (1/1/1/1) ; 0 (0.7143/0.3333/0.2/0) ; 1 (1/1/1/1) ; 0 (0.8333/0.6/0.25/0) ; 0.6148 (0.7143/0.6667/0.6/0.5)

Source

��

�@

�a

�n

��

�N�j�Q

�\�U

�C

Ref 0

Please

recommend

good

Italian

restaurant.

Ref 1

Please

tell

where

can

find

good

Italian

restaurant.

Ref 2

you

know

good

Italian

place?

Ref 3

Please

recommend

good

place

for

Italian

food.

Ref 4

Could

you

please

tell

where

there's

Italian

restaurant

with

great

food?

Ref 5

Could

you

please

let

know

where

find

good

Italian

restaurant?

Ref 6

Could

you

tell

what

restaurant

could

for

delicious

Italian

food?

Ref 7

you

know

any

good

Italian

restaurants?

Ref 8

Could

you

recommend

good

Italian

restaurant?

Ref 9

there

good

Italian

restaurant

you'd

recommend?

Ref 10

Could

you

recommend

good

Italian

restaurant?

Ref 11

I'd

know

the

name

Italian

restaurant

with

good

food.

Ref 12

Can

you

suggest

any

good

Italian

restaurants?

Ref 13

Please

suggest

delicious

Italian

restaurant.

Ref 14

Please

tell

about

good

Italian

restaurant.

Ref 15

Please

show

where

find

good

Italian

restaurant.

Output 0

Please

recommend

good

Italian

restaurant.

N-grams

Please	recommend	a	good	Italian	restaurant.
Please	recommend	a	good	Italian	restaurant.
Please recommend		a good		Italian restaurant.
Please recommend a			good Italian
Please recommend a good
	recommend a		good Italian restaurant.
	recommend a good
	recommend a good Italian
		a good Italian
		a good Italian restaurant.

Output 1

please

recommend

good

italian

restaurant

N-grams

please	recommend	a	good	italian	restaurant	.
please	recommend	a	good		restaurant
	recommend a
	recommend a good
		a good

Output 2

Please

recommend

good

Italian

restaurant.

N-grams

Please	recommend	a	good	Italian	restaurant.
Please	recommend	a	good	Italian	restaurant.
Please recommend		a good		Italian restaurant.
Please recommend a			good Italian
Please recommend a good
	recommend a		good Italian restaurant.
	recommend a good
	recommend a good Italian
		a good Italian
		a good Italian restaurant.

Output 3

Please

recommend

very

Italian

restaurant.

N-grams

Please	recommend	a	very	Italian	restaurant.
Please	recommend	a		Italian	restaurant.
Please recommend				Italian restaurant.
Please recommend a
	recommend a

Output 4

Please

recommend

good

Italian

dining

room.

N-grams

Please	recommend	a	good	Italian	dining	room.
Please	recommend	a	good	Italian
Please recommend		a good
Please recommend a			good Italian
Please recommend a good
	recommend a
	recommend a good
	recommend a good Italian
		a good Italian

Sentence 193) BLEU: 0.6687 (1/0.8/0.75/0.3333) ; 0 (0.5714/0.5/0.4/0) ; 0.6687 (1/0.8/0.75/0.3333) ; 0 (0.8/0.5/0/0) ; 0.6687 (1/0.8/0.75/0.3333)

Source

��

�b

��

�@

��

�p�M

�C

Ref 0

I'm

looking

for

penknife.

Ref 1

want

penknife.

Ref 2

What

looking

for

small

knife.

Ref 3

I'd

find

penknife.

Ref 4

want

find

little

knife.

Ref 5

hoping

find

small

pocket

knife.

Ref 6

want

get

small

knife.

Ref 7

I'd

paring

knife.

Ref 8

want

get

jack

knife.

Ref 9

I'm

small

paring

knife.

Ref 10

would

penknife.

Ref 11

want

buy

penknife.

Ref 12

you

sell

penknives?

Ref 13

I'm

looking

for

pocket

knife.

Ref 14

would

pocket

knife.

Ref 15

would

buy

pocket

knife.

Output 0

looking

for

knife.

N-grams

I	am	looking	for	a	knife.
I	am	looking	for	a	knife.
I am		looking for
I am looking			for a
I am looking for
	am looking
	am looking for
		looking for a

Output 1

looking

for

knife

N-grams

i	am	looking	for	a	knife	.
	am	looking	for	a
	am looking		for a
	am looking for
		looking for
		looking for a

Output 2

looking

for

knife.

N-grams

I	am	looking	for	a	knife.
I	am	looking	for	a	knife.
I am		looking for
I am looking			for a
I am looking for
	am looking
	am looking for
		looking for a

Output 3

finding

penknife.

N-grams

I	am	finding	a	penknife.
I	am		a	penknife.
I am			a penknife.

Output 4

looking

for

knife.

N-grams

I	am	looking	for	a	knife.
I	am	looking	for	a	knife.
I am		looking for
I am looking			for a
I am looking for
	am looking
	am looking for
		looking for a

Sentence 194) BLEU: 0 (0.4/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.1111/0/0/0)

Source

��

�@

��

��~

��

�i��

�C

Ref 0

medium

Coke,

please.

Ref 1

Please

give

medium

cola.

Ref 2

I'd

medium

cola,

please.

Ref 3

medium

cola,

please.

Ref 4

Please

bring

one

medium

Coke.

Ref 5

I'd

medium-size

Coke.

Ref 6

I'll

have

one

Coke,

medium,

please.

Ref 7

I'd

medium

Coke,

please.

Ref 8

Please

give

medium

Coke.

Ref 9

want

medium

Coke,

please.

Ref 10

I'd

medium-sized

Coke.

Ref 11

Could

you

get

medium

Coke?

Ref 12

I'll

have

medium-sized

Coke.

Ref 13

medium

sized

cola,

please.

Ref 14

One

medium

cola,

please.

Ref 15

Please

give

one

medium

sized

cola.

Output 0

Brought

bottle

Coke.

N-grams

Brought	a	bottle	of	Coke.
	a			Coke.

Output 1

bottle

N-grams

a	bottle	of	to	.
a

Output 2

Brought

bottle

Coke.

N-grams

Brought	a	bottle	of	Coke.
	a			Coke.

Output 3

Please

come

one

cola

inside

bottle.

N-grams

Please	come	to	one	cola	of	inside	bottle.
Please			one

Output 4

Invites

bottle

possible

happy.

N-grams

Invites	a	bottle	to	be	possible	to	be	happy.
	a

Sentence 195) BLEU: 0 (0.8571/0.3333/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.8333/0/0/0) ; 0.5373 (0.8333/0.6/0.5/0.3333) ; 0 (0.8571/0.3333/0/0)

Source

��

�b

��

�pô

��

�A

�H

Ref 0

Where

can

contact

you?

Ref 1

Where

can

reach

you?

Ref 2

Where

can

get

hold

you?

Ref 3

Where

can

get

touch

with

you?

Ref 4

Where

can

get

hold

you?

Ref 5

Where

can

reach

you?

Ref 6

Where

would

able

reach

you?

Ref 7

Where

get

hold

you?

Ref 8

Where

should

call

get

hold

you?

Ref 9

Where

call

contact

you?

Ref 10

Where

can

you

reached?

Ref 11

Where

can

find

you?

Ref 12

What

are

your

contact

details?

Ref 13

Where

the

best

place

contact

at?

Ref 14

What

place

can

contact

you

best?

Ref 15

Where

may

get

hold

you?

Output 0

Which

can

contact

with

you?

N-grams

Which	can	I	in	contact	with	you?
	can	I	in	contact	with	you?
	can I				with you?

Output 1

can

you

which

contact

N-grams

i	can	you	which	contact	?
	can	you		contact
	can you

Output 2

Where

can

link

you?

N-grams

Where	I	can	link	to	you?
Where	I	can		to	you?

Output 3

Which

can

contact

you

at?

N-grams

Which	can	I	contact	you	at?
	can	I	contact	you	at?
	can I		contact you
	can I contact
	can I contact you
		I contact
		I contact you

Output 4

Which

can

contact

with

you?

N-grams

Which	can	I	in	contact	with	you?
	can	I	in	contact	with	you?
	can I				with you?

Sentence 196) BLEU: 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0) ; 0 (0/0/0/0)

Source

��

�C

Ref 0

Hello.

Ref 1

Hi.

Ref 2

Howdy.

Ref 3

Good	afternoon.

Ref 4

Hey.

Ref 5

Afternoon.

Ref 6

How's

it?

Ref 7

Hello

there.

Ref 8

What's

new?

Ref 9

Hey.

Ref 10

Hi.

Ref 11

there.

Ref 12

Good	afternoon.

Ref 13

Good	afternoon.

Ref 14

Good

day.

Ref 15

Hello.

Output 0

Hello.

N-grams

Hello.

Output 1

N-grams

Output 2

餵.

N-grams

餵.

Output 3

Hello.

N-grams

Hello.

Output 4

Feeding.

N-grams

Feeding.

Sentence 197) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�H

Ref 0

Are

there

any

intermissions?

Ref 1

Are

there

any

breaks?

Ref 2

there

intermission.

Ref 3

Does

have

any

intermissions?

Ref 4

there

break?

Ref 5

there

rest

period?

Ref 6

Does

have

intermissions?

Ref 7

Will

there

intermission?

Ref 8

there

going

intermission?

Ref 9

there

interval?

Ref 10

Does

this

have

any

breaks?

Ref 11

Will

there

interval?

Ref 12

there

intermission?

Ref 13

Are

there

any

breaks?

Ref 14

there

break

during

the

show?

Ref 15

Are

there

any

intermissions?

Output 0

You

have

any

intermittent?

N-grams

You	have	any	intermittent?
	have	any
	have any

Output 1

any

intermittent

N-grams

any	intermittent	?
any

Output 2

You

have

any

intermittent?

N-grams

You	have	any	intermittent?
	have	any
	have any

Output 3

Any	intermittent?

N-grams

Any	intermittent?

Output 4

Has

any

intermittence?

N-grams

Has	any	intermittence?
	any

Sentence 198) BLEU: 0 (1/1/0/0) ; 0 (0.4/0.25/0/0) ; 0 (1/1/0/0) ; 0 (1/1/0/0) ; 0 (0.75/0.3333/0/0)

Source

��

�Q

�F

�C

Ref 0

It's

too

expensive.

Ref 1

costs

too

much.

Ref 2

The

price

too

high.

Ref 3

overpriced.

Ref 4

It's

too

much.

Ref 5

costs

too

much.

Ref 6

That's

too

high.

Ref 7

That's

too

pricey.

Ref 8

That's

too

high.

Ref 9

That

costs

too

much.

Ref 10

It's

too

much

for

me.

Ref 11

It's

costs

too

much.

Ref 12

Too	expensive.

Ref 13

It's

too

much.

Ref 14

costs

too

much.

Ref 15

The

price

too

high.

Output 0

too

expensive.

N-grams

It	is	too	expensive.
It	is	too	expensive.
It is		too expensive.
	is too

Output 1

too

expensive

N-grams

it	is	too	expensive	.
	is	too
	is too

Output 2

too

expensive.

N-grams

It	is	too	expensive.
It	is	too	expensive.
It is		too expensive.
	is too

Output 3

too

expensive.

N-grams

It	is	too	expensive.
It	is	too	expensive.
It is		too expensive.
	is too

Output 4

was

too

expensive.

N-grams

It	was	too	expensive.
It		too	expensive.
		too expensive.

Sentence 199) BLEU: 0 (1/0.6667/0/0) ; 0 (0.6/0/0/0) ; 0 (1/0.6667/0/0) ; 0 (1/0.6667/0/0) ; 0 (1/0.6667/0/0)

Source

��

�O

�@

��

�ǥ�

�C

Ref 0

I'm

student.

Ref 1

student

what

am.

Ref 2

enrolled

school.

Ref 3

Student.

Ref 4

school.

Ref 5

I'm

school.

Ref 6

I'm

going

school.

Ref 7

have

student

status.

Ref 8

status

student.

Ref 9

study.

Ref 10

I'm

studying.

Ref 11

school.

Ref 12

college.

Ref 13

attend

college.

Ref 14

currently

attend

college.

Ref 15

I'm

student.

Output 0

student.

N-grams

I	am	a	student.
I	am	a	student.
I am		a student.

Output 1

student

N-grams

i	am	a	student	.
	am	a	student

Output 2

student.

N-grams

I	am	a	student.
I	am	a	student.
I am		a student.

Output 3

student.

N-grams

I	am	a	student.
I	am	a	student.
I am		a student.

Output 4

student.

N-grams

I	am	a	student.
I	am	a	student.
I am		a student.

Sentence 200) BLEU: 0.1517 (0.8049/0.325/0.07692/0.02632) ; 0 (0.7333/0.2414/0.07143/0) ; 0.1478 (0.6452/0.2/0.1034/0.03571) ; 0.1517 (0.8049/0.325/0.07692/0.02632) ; 0 (0.64/0.1667/0.04348/0)

Source

�n��

�A

�٢��

�k�h

�C

��

�o��

�B��

�e

��

�Ĥ�

�C

��ݳB

�ȯZ

��

�@�h

�

��

�A

�h

�ĩ�

��

�C

��

�p��

�Y

�@

��

�A

��

�b

��

�W

��

�C

�n

��

�H

Ref 0

All

right,

Ms.

Kimura.

Please

take

this

prescription

the

pharmacy.

The

nurse

duty

reception

will

give

you

directions

the

pharmacy.

Take

the

medicine

every

six

hours

and

stay

bed

today.

Okay?

Ref 1

problem,

Ms.

Kimura.

Please

take

this

prescription

the

pharmacy.

The

nurse

the

desk

will

give

you

directions

the

pharmacy.

Take

the

medicine

once

every

six

hours

and

stay

bed

today.

Alright?

Ref 2

worries,

Ms.

Kimura.

Please

take

this

prescription

the

pharmacy.

The

nurse

the

reception

desk

will

give

you

directions

there.

Take

this

medicine

one

time

every

six

hours

and

get

some

sleep

today.

Any

questions?

Ref 3

It's

OK,

Ms.

Kimura.

Please

take

this

prescription

the

pharmacy.

You

can

get

directions

from

the

nurse

the

reception

desk.

Take

this

medicine

once

every

six

hours

and

stay

bed

today.

OK?

Ref 4

Well,

that's

OK,

Ms.

Kimura.

Please

bring

the

prescription

drugstore.

The

nurse

the

desk

will

tell

you

how

get

the

drugstore.

Take

the

medicine

six

hour

intervals

and

don't

get

out

bed

today.

All

right?

Ref 5

Well,

that's

fine,

Ms.

Kimura.

Please

pharmacy

with

this

prescription.

The

nurse

working

the

reception

desk

will

explain

how

get

the

pharmacy.

Take

the

medication

every

six

hours

and

just

sleep

today.

Got

it?

Ref 6

Well,

then,

Ms.

Kimura.

Please

take

the

prescription

drugstore.

The

nurse

reception

will

let

you

know

how

get

drugstore.

Take

the

medicine

once

every

six

hours

and

stay

bed

today.

Okay,

then?

Ref 7

That'll

all,

Ms.

Kimura.

Could

you

bring

this

prescription

the

pharmacy?

The

nurse

reception

will

tell

you

how

get

the

pharmacy.

sure

rest

today

and

take

your

medication

every

six

hours.

Alright?

Ref 8

Okay,

Ms.

Kimura.

Just

take

this

prescription

the

drugstore.

The

nurse

reception

can

show

you

how

get

there.

Please

rest

today

and

take

the

medication

every

six

hours.

that

clear?

Ref 9

Okay

then,

Ms.

Kimura.

the

drugstore

with

this

prescription.

The

nurse

reception

can

provide

you

with

instructions

how

get

there.

Take

the

medication

every

six

hours

and

rest

well.

you

understand?

Ref 10

Okay,

Ms.

Kimura.

Take

this

prescription

the

pharmacy.

The

on-duty

nurse

reception

will

show

you

how

get

the

pharmacy.

I'd

you

take

the

medicine

every

six

hours

and

rest

bed

today.

All

right?

Ref 11

Right,

Ms.

Kimura.

Kindly

take

this

prescription

the

pharmacy.

The

nurse

reception

will

show

you

how

you

can

get

the

pharmacy.

Please

take

the

medicine

every

six

hours

and

just

rest

for

today.

Understood?

Ref 12

Well

then,

Ms.

Kimura.

I'd

you

take

this

prescription

the

pharmacy.

The

nurse

charge

reception

will

show

you

the

way

the

pharmacy.

You

need

take

the

medicine

every

six

hours

and

lie

bed

today.

that

clear?

Ref 13

That's

fine

Mr.

Kimura.

Please

give

this

prescription

pharmacist.

The

nurse

reception

will

tell

you

how

get

pharmacy.

Take

the

medication

once

every

six

hours

and

please

rest

bed

today.

you

understand?

Ref 14

That

will

all

Mr.

Kimura.

Please

take

this

prescription

the

pharmacist.

The

nurse

the

reception

desk

will

tell

you

how

get

the

pharmacy.

Take

the

medication

once

every

six

hours

and

rest

bed

for

today.

Did

you

understand?

Ref 15

That

fine

Mr.

Kimura.

Please

take

this

prescription

the

drug

store.

The

nurse

reception

will

give

you

directions

the

drug

store.

Take

the

medicine

every

six

hours

and

sleep

for

today.

Understood?

Output 0

Okay,

the

��

lady.

Please

send

this

prescription

the

medicine

Square.

The

nurse

reception

duty

will

point

you

the

road

pharmacy.

Take

medicine

every

six

hours,

take

rest

the

bed

today.

Good?

N-grams

Okay,

the

��

lady.

Please

send

this

prescription

the

medicine

Square.

The

nurse

reception

duty

will

point

you

the

road

pharmacy.

Take

medicine

every

six

hours,

take

rest

the

bed

today.

Good?

Okay,

the

Please

this

prescription

the

medicine

The

nurse

reception

duty

will

you

the

pharmacy.

Take

medicine every

six

take

rest

the

bed

today.

this prescription

to the

The nurse

of reception

on duty

go to

pharmacy. Take

medicine every six

bed today.

this prescription to

the medicine

to the

every

this prescription to the

every six

prescription to

prescription to the

Output 1

kimura

please

send

the

prescription

reception

duty

will

refer

you

the

every

six

hours

the

medicine

bed

rest

today

this

nurse

road

pharmacy

good

N-grams

kimura

please

send

the

prescription

reception

duty

will

refer

you

the

every

six

hours

the

medicine

bed

rest

today

this

nurse

road

pharmacy

good

please

the

prescription

reception

duty

will

you

the

every

six

hours

the

medicine

bed

rest

today

this

nurse

pharmacy

the prescription

you the

every six

the medicine

rest today

the prescription to

every six hours

prescription to

six hours

Output 2

Well,

Kimura

President.

Please

send

the

prescription

prescription.

Reception

duty

nurses

will

refer

you

the

way

pharmacies.

Every

six

hours

eat

the

medicine,

bed

rest

today.

Please?

N-grams

Well,

Kimura

President.

Please

send

the

prescription

prescription.

Reception

duty

nurses

will

refer

you

the

way

pharmacies.

Every

six

hours

eat

the

medicine,

bed

rest

today.

Please?

Well,

Please

the

prescription

prescription.

duty

will

you

the

way

six

hours

the

bed

rest

today.

the prescription

you the

way to

six hours

the prescription to

you the way

prescription to

you the way to

the way

the way to

Output 3

Okay,

the

�٢��

lady.

Please

send

this

prescription

the

medicine

square.

The

nurse

reception

duty

will

point

you

the

road

pharmacy.

Take

medicine

every

six

hours,

take

rest

the

bed

today.

Good?

N-grams

Okay,

the

�٢��

lady.

Please

send

this

prescription

the

medicine

square.

The

nurse

reception

duty

will

point

you

the

road

pharmacy.

Take

medicine

every

six

hours,

take

rest

the

bed

today.

Good?

Okay,

the

Please

this

prescription

the

medicine

The

nurse

reception

duty

will

you

the

pharmacy.

Take

medicine every

six

take

rest

the

bed

today.

this prescription

to the

The nurse

of reception

on duty

go to

pharmacy. Take

medicine every six

bed today.

this prescription to

the medicine

to the

every

this prescription to the

every six

prescription to

prescription to the

Output 4

Good,

Ms.

Kimura.

Please

deliver

this

prescription

the

formula.

Reception

desk

duty's

nurse

will

refer

for

you

goes

the

pharmacy

the

road.

Every

N-grams

Good,

Ms.

Kimura.

Please

deliver

this

prescription

the

formula.

Reception

desk

duty's

nurse

will

refer

for

you

goes

the

pharmacy

the

road.

Every

Ms.

Kimura.

Please

this

prescription

the

desk

nurse

will

for

you

the

pharmacy

the

Ms. Kimura.

this prescription

to the

Ms. Kimura. Please

Kimura. Please

Sentence 201) BLEU: 0 (0.5/0.1111/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.5/0.1111/0/0) ; 0 (0.25/0/0/0)

Source

��

�ڭ�

��

�i

��

�H

Ref 0

Will

you

take

our

picture?

Ref 1

Will

you

take

picture

for

me?

Ref 2

Would

you

mind

taking

picture?

Ref 3

Could

you

take

picture,

please?

Ref 4

Would

you

mind

taking

picture

for

us?

Ref 5

Could

you

snap

our

picture?

Ref 6

Can

you

shoot

picture

us?

Ref 7

you

mind

taking

our

picture?

Ref 8

Would

you

please

take

snapshot

us?

Ref 9

Could

bother

you

take

our

picture?

Ref 10

Please

take

our

photo.

Ref 11

Could

you

take

photo

us?

Ref 12

Would

you

mind

taking

our

picture?

Ref 13

Would

you

mind

taking

our

picture

for

us?

Ref 14

Could

you

take

our

picture

for

us?

Ref 15

Could

you

snap

photo

us,

please?

Output 0

Can

shine

piece

for

us?

N-grams

Can	shine	on	a	piece	to	be	like	for	us?
Can			a		to			for	us?
								for us?

Output 1

according

help

can

N-grams

according	to	help	can	us	?
	to

Output 2

According

Zhang,

help

you?

N-grams

According	to	Zhang,	as	we	help	you?
	to			we

Output 3

Can

shine

piece

for

us?

N-grams

Can	shine	on	a	piece	to	be	like	for	us?
Can			a		to			for	us?
								for us?

Output 4

Can

help

according

open

the

elephant?

N-grams

Can	help	us	according	to	open	the	elephant?
Can				to

Sentence 202) BLEU: 0.3999 (0.8095/0.45/0.3158/0.2222) ; 0.3051 (0.7/0.3158/0.2222/0.1765) ; 0.4093 (0.85/0.4211/0.3333/0.2353) ; 0.3999 (0.8095/0.45/0.3158/0.2222) ; 0.3967 (0.75/0.4211/0.3333/0.2353)

Source

��

�d�l

��

��w

��W

��

�C

��~

�A

�o

�]

��

�X

�o��

�n

��

��\

�C

Ref 0

wife

doesn't

cook

the

morning.

Besides,

she

can't

make

breakfast

good

this.

Ref 1

wife

doesn't

cooking

the

mornings.

Besides,

her

breakfasts

aren't

good

this.

Ref 2

wife

doesn't

fix

food

the

morning.

Besides,

her

food

isn't

good

this.

Ref 3

Breakfast

not

meal

that

wife

enjoys

fixing.

Besides,

her

cooking

isn't

good

this.

Ref 4

wife

isn't

crazy

about

cooking

the

morning.

top

that,

she

can't

make

breakfast

this

great.

Ref 5

wife

isn't

interested

cooking

the

morning.

Moreover,

she

can't

produce

breakfast

this

delicious.

Ref 6

better

half

doesn't

enjoy

cooking

the

morning.

Besides

that,

she

can't

put

something

together

that's

tasty

this.

Ref 7

wife

isn't

fond

cooking

the

morning.

Anyway,

her

breakfast

would

never

taste

this

good.

Ref 8

wife

dislikes

cooking

the

morning.

Also,

she

wouldn't

able

make

anything

this

tasty.

Ref 9

wife

prefers

not

cook

the

morning.

And,

besides,

she

couldn't

make

breakfast

this

good.

Ref 10

wife

hates

cooking

the

morning.

Anyway,

her

breakfast

where

near

good

this.

Ref 11

wife

isn't

ken

cooking

the

morning.

any

case,

she

doesn't

cook

breakfast

well

this.

Ref 12

wife

dislikes

cook

the

morning.

Anyhow,

your

breakfast

much

better

than

hers.

Ref 13

wife

doesn't

prepare

breakfast.

top

that,

she

can't

make

breakfast

good

this.

Ref 14

wife

prefers

not

cook

the

mornings.

add,

she

doesn't

make

breakfast

quite

this

good.

Ref 15

wife

does

not

cook

the

morning.

Also,

can't

make

breakfast

this

tasty.

Output 0

wife

doesn't

cook

meal

the

morning.

addition,

she

also

could

not

does

good

breakfast.

N-grams

wife

doesn't

cook

meal

the

morning.

addition,

she

also

could

not

does

good

breakfast.

wife

doesn't

cook

meal

the

morning.

she

not

does

good

breakfast.

My wife

doesn't like

to cook

a meal

in the

morning. In

My wife doesn't

like to

in the morning.

My wife doesn't like

in the morning. In

wife doesn't

like to cook

the morning.

wife doesn't like

the morning. In

wife doesn't like to

doesn't like to

doesn't like to cook

Output 1

wife

does

not

cook

the

morning

addition

she

also

such

good

breakfast

N-grams

wife

does

not

cook

the

morning

addition

she

also

such

good

breakfast

wife

does

not

cook

the

she

good

breakfast

my wife

does not

like to

wife does

not like

to cook

wife does not

like to cook

wife does not like

does not like

does not like to

not like to

not like to cook

Output 2

wife

does

not

cook

the

morning.

addition,

she

also

not

able

such

good

breakfast.

N-grams

wife

does

not

cook

the

morning.

addition,

she

also

not

able

such

good

breakfast.

wife

does

not

cook

the

morning.

she

able

good

breakfast.

My wife

does not

like to

the morning.

My wife does

not like

to cook

the morning. In

My wife does not

like to cook

morning. In

wife does

not like to

wife does not

wife does not like

does not like

does not like to

not like to cook

Output 3

wife

doesn't

cook

meal

the

morning.

addition,

she

also

could

not

does

good

breakfast.

N-grams

wife

doesn't

cook

meal

the

morning.

addition,

she

also

could

not

does

good

breakfast.

wife

doesn't

cook

meal

the

morning.

she

not

does

good

breakfast.

My wife

doesn't like

to cook

a meal

in the

morning. In

My wife doesn't

like to

in the morning.

My wife doesn't like

in the morning. In

wife doesn't

like to cook

the morning.

wife doesn't like

the morning. In

wife doesn't like to

doesn't like to

doesn't like to cook

Output 4

wife

does

not

preparing

food

the

morning.

addition,

she

also

cannot

make

the

such

good

breakfast.

N-grams

wife

does

not

preparing

food

the

morning.

addition,

she

also

cannot

make

the

such

good

breakfast.

wife

does

not

food

the

morning.

she

make

good

breakfast.

My wife

does not

food in

the morning.

My wife does

not like

food in the

morning. In

My wife does not

food in the morning.

wife does

in the

wife does not

in the morning.

wife does not like

in the morning. In

does not like

the morning. In

Sentence 203) BLEU: 0 (0.625/0.2857/0/0) ; 0 (0.375/0.1429/0/0) ; 0 (0.625/0.1429/0/0) ; 0 (0.1/0/0/0) ; 0 (0.625/0.2857/0/0)

Source

�{�b

�ʦѶ�

��b

�W�t

��

��ּ@

�H

Ref 0

What

kind

musicals

are

Broadway

right

now?

Ref 1

What

sort

musicals

are

playing

Broadway

now?

Ref 2

Broadway,

what

kinds

musicals

are

there?

Ref 3

What

kinds

musicals

are

playing

Broadway?

Ref 4

What

type

musicals

are

playing

Broadway

now?

Ref 5

Currently,

what

sort

musical

productions

are

showing

Broadway?

Ref 6

present,

what

musicals

are

being

performed

Broadway?

Ref 7

Which

musicals

are

playing

Broadway

now?

Ref 8

What

musicals

are

playing

Broadway

currently?

Ref 9

What

are

the

latest

musicals

playing

Broadway?

Ref 10

What

musicals

are

playing

Broadway

now?

Ref 11

What

sort

musicals

can

see

these

days

Broadway?

Ref 12

What

are

the

latest

kinds

musicals

Broadway?

Ref 13

What

types

musicals

are

playing

Broadway

these

days?

Ref 14

What

musicals

are

playing

Broadway

nowadays?

Ref 15

What

sorts

musicals

are

playing

Broadway

now?

Output 0

Which

kind

musical

now

Broadway

performing?

N-grams

Which	kind	of	musical	now	is	Broadway	performing?
Which	kind	of	musical			Broadway
	kind of
		of musical

Output 1

now

kind

broadway

musical

which

N-grams

now	kind	of	broadway	musical	is	which	?
	kind	of		musical
	kind of

Output 2

Now

what

kind

Broadway

musical

staged?

N-grams

Now	what	kind	of	Broadway	musical	is	staged?
	what	kind	of	Broadway	musical
		kind of

Output 3

The

Broadway

presenting

public

now

which

music

play?

N-grams

The	Broadway	is	presenting	to	public	now	which	music	play?
	Broadway

Output 4

Which

kind

musical

now

Broadway

performing?

N-grams

Which	kind	of	musical	now	is	Broadway	performing?
Which	kind	of	musical			Broadway
	kind of
		of musical

Sentence 204) BLEU: 0 (1/0/0/0) ; 0 (0.25/0/0/0) ; 0 (1/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6667/0/0/0)

Source

�

�A

��

�h

��

�C

Ref 0

No,

there

are

several

more.

Ref 1

No,

there

are

many

more.

Ref 2

No,there

are

some

more.

Ref 3

No,

several

are

left.

Ref 4

No,

there

are

lot

more.

Ref 5

No,

have

numerous

other

ones.

Ref 6

No,

have

several

others.

Ref 7

No,

several

are

available.

Ref 8

No,

we've

got

several

more.

Ref 9

No,

there

are

few

left.

Ref 10

No,

several

more.

Ref 11

No,

many

more.

Ref 12

No,

there

are

many

more.

Ref 13

Nope,

there

are

more.

Ref 14

No,

there

are

few

more.

Ref 15

No,

there

some

more.

Output 0

No,

have

more.

N-grams

No,	have	more.
No,	have	more.

Output 1

N-grams

no	,	more	.
		more

Output 2

No,

have

more.

N-grams

No,	have	more.
No,	have	more.

Output 3

There

not.

N-grams

There	is	more	not.
	is	more

Output 4

No,

has

more.

N-grams

No,	has	more.
No,		more.

Sentence 205) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.75/0.6667/0.5/0)

Source

��

�o��

�C

Ref 0

I'd

this,

please.

Ref 1

This,

please.

Ref 2

Give

this,

please.

Ref 3

This

what

want.

Ref 4

I'll

take

this,

please.

Ref 5

Please

give

this

one.

Ref 6

I'll

buy

this

one,

please.

Ref 7

Please

give

this

me.

Ref 8

May

have

this?

Ref 9

want

this,

please.

Ref 10

May

have

this?

Ref 11

Could

get

this?

Ref 12

This,

please.

Ref 13

I'll

take

this,

please.

Ref 14

will

buy

this,

please.

Ref 15

This

one,

please.

Output 0

Please

give

this.

N-grams

Please	give	me	this.
Please	give	me
Please give
Please give me
	give me

Output 1

please

give

this

N-grams

please	give	me	this	.
	give	me	this
	give me
	give me this
		me this

Output 2

Please

give

this.

N-grams

Please	give	me	this.
Please	give	me
Please give
Please give me
	give me

Output 3

Please

give

this.

N-grams

Please	give	me	this.
Please	give	me
Please give
Please give me
	give me

Output 4

Please

give

this.

N-grams

Please	give	me	this.
Please	give	me
Please give
Please give me
	give me

Sentence 206) BLEU: 0 (1/1/0.6667/0) ; 0 (0.6/0.5/0/0) ; 0 (1/1/0.6667/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.8/0.25/0/0)

Source

�ڭ�

�b

�o��

�@

�P

�F

�C

Ref 0

We're

here

for

week.

Ref 1

We'll

here

for

week.

Ref 2

week

how

long

we'll

here.

Ref 3

We'll

staying

for

week.

Ref 4

We'll

staying

here

for

one-week

period.

Ref 5

We'll

here

for

week.

Ref 6

We're

going

stay

for

week.

Ref 7

We'll

staying

for

week.

Ref 8

plan

spend

week

here.

Ref 9

We're

going

stay

for

week.

Ref 10

We'll

staying

here

week.

Ref 11

are

going

here

for

week.

Ref 12

Our

stay

here

for

one

week.

Ref 13

will

here

for

the

duration

one

week.

Ref 14

are

visiting

here

for

one

week.

Ref 15

are

here

for

the

period

one

week.

Output 0

are

here

week.

N-grams

We	are	here	a	week.
We	are	here	a	week.
We are		here a
We are here			a week.
	are here
		here a week.

Output 1

here

week

N-grams

we	here	a	week	.
	here	a	week
	here a
		a week

Output 2

are

here

week.

N-grams

We	are	here	a	week.
We	are	here	a	week.
We are		here a
We are here			a week.
	are here
		here a week.

Output 3

here

week.

N-grams

We	at	here	a	week.
We		here	a	week.
		here a
		here a week.
			a week.

Output 4

here

one

week.

N-grams

We	in	here	one	week.
We		here	one	week.
			one week.

Sentence 207) BLEU: 0.7953 (1/0.8/0.75/0.6667) ; 0.4111 (0.5714/0.5/0.4/0.25) ; 0.7598 (0.8333/0.8/0.75/0.6667) ; 0.7953 (1/0.8/0.75/0.6667) ; 0.7953 (1/0.8/0.75/0.6667)

Source

��M

�C

��

��g

�o

�i

��

�C

Ref 0

Sure.

Please

fill

out

this

form.

Ref 1

OK.

Please

fill

this

form.

Ref 2

Alright.

Please

complete

this

form.

Ref 3

Sure.

Please

complete

the

form.

Ref 4

problem.

Could

you

please

complete

this

form?

Ref 5

Absolutely.

Would

you

please

fill

this

form?

Ref 6

Certainly.

Would

you

please

provide

the

information

this

form?

Ref 7

Certainly.

Would

you

fill

out

this

form?

Ref 8

course.

you

mind

filling

out

this

form?

Ref 9

Absolutely.

Could

you

complete

this

form,

please?

Ref 10

Certainly.

Could

you

fill

this

form?

Ref 11

problem.

Kindly

complete

this

form.

Ref 12

Very

well.

Would

you

mind

filling

out

this

form?

Ref 13

understand.

Please

fill

out

this

document.

Ref 14

Understood.

Please

write

your

information

into

this

form.

Ref 15

Yes.

Please

fill

this

paper.

Output 0

Certainly.

Please

fill

this

form.

N-grams

Certainly.	Please	fill	in	this	form.
Certainly.	Please	fill	in	this	form.
	Please fill		in this
	Please fill in			this form.
	Please fill in this
		fill in
		fill in this
		fill in this form.
			in this form.

Output 1

please

fill

this

form

certainly

N-grams

please	fill	in	this	form	certainly	.
please	fill	in	this
please fill		in this
please fill in
please fill in this
	fill in
	fill in this

Output 2

當然.

Please

fill

this

form.

N-grams

當然.	Please	fill	in	this	form.
	Please	fill	in	this	form.
	Please fill		in this
	Please fill in			this form.
	Please fill in this
		fill in
		fill in this
		fill in this form.
			in this form.

Output 3

Certainly.

Please

fill

this

form.

N-grams

Certainly.	Please	fill	in	this	form.
Certainly.	Please	fill	in	this	form.
	Please fill		in this
	Please fill in			this form.
	Please fill in this
		fill in
		fill in this
		fill in this form.
			in this form.

Output 4

Certainly.

Please

fill

this

form.

N-grams

Certainly.	Please	fill	in	this	form.
Certainly.	Please	fill	in	this	form.
	Please fill		in this
	Please fill in			this form.
	Please fill in this
		fill in
		fill in this
		fill in this form.
			in this form.

Sentence 208) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.25/0/0/0)

Source

��p

��Z

�A

�C

Ref 0

Sorry

trouble

you.

Ref 1

I'm

sorry

have

troubled

you.

Ref 2

I'm

sorry

have

caused

any

trouble.

Ref 3

I'm

sorry

put

you

out.

Ref 4

I'm

sorry

bother.

Ref 5

Pardon

for

bothering

you.

Ref 6

apologize

for

the

trouble.

Ref 7

I'm

sorry

bother

you.

Ref 8

Sorry

for

the

inconvenience.

Ref 9

apologize

for

inconveniencing

you.

Ref 10

Sorry

for

bothering

you.

Ref 11

Sorry

have

caused

you

any

trouble.

Ref 12

Sorry

for

the

trouble.

Ref 13

sorry

have

bothered

you.

Ref 14

sorry

have

caused

you

trouble.

Ref 15

sorry

that

caused

trouble.

Output 0

Sorry

disturb

you.

N-grams

Sorry	to	disturb	you.
Sorry	to		you.
Sorry to

Output 1

you

N-grams

to	you	.
to	you

Output 2

Sorry

disturb

you.

N-grams

Sorry	to	disturb	you.
Sorry	to		you.
Sorry to

Output 3

Excuse

bother

you.

N-grams

Excuse	me	to	bother	you.
	me	to	bother	you.
		to bother
		to bother you.
			bother you.

Output 4

The

regret

disturbs

you.

N-grams

The	regret	disturbs	you.
			you.

Sentence 209) BLEU: 0.3826 (0.75/0.4286/0.3333/0.2) ; 0 (0.375/0/0/0) ; 0 (0.1667/0/0/0) ; 0.3826 (0.75/0.4286/0.3333/0.2) ; 0 (0.5/0.1429/0/0)

Source

�A

�{�b

��Y

��

�h��

�H

Ref 0

How

much

you

have

with

you

right

now?

Ref 1

How

much

you

have

you

now?

Ref 2

How

much

you

have

you?

Ref 3

What

you

have

you

now?

Ref 4

How

much

money

are

you

carrying

this

time?

Ref 5

How

much

you

have

you?

Ref 6

How

much

have

you

got

with

you

right

now?

Ref 7

How

much

are

you

carrying

with

you

right

now?

Ref 8

What

you

have

you

right

now?

Ref 9

What

have

you

got

with

you

right

now?

Ref 10

How

much

are

you

carrying

with

you?

Ref 11

How

much

money

have

you

got

you

now?

Ref 12

What

amount

money

you

have

you

now?

Ref 13

How

much

you

have

you

now?

Ref 14

How

much

are

you

carrying

now?

Ref 15

How

much

have

you

got

now?

Output 0

How

much

you

hand

have

now?

N-grams

How	much	do	you	in	hand	have	now?
How	much	do	you			have	now?
How much		do you
How much do
How much do you
	much do
	much do you

Output 1

you

now

how

many

hand

have

N-grams

you	now	how	many	do	hand	have	?
you				do		have

Output 2

You

are

now

on-hand,

how

many?

N-grams

You	are	now	on-hand,	how	many?
	are

Output 3

How

much

you

hand

have

now?

N-grams

How	much	do	you	in	hand	have	now?
How	much	do	you			have	now?
How much		do you
How much do
How much do you
	much do
	much do you

Output 4

How

many

now

you

hand

have?

N-grams

How	many	now	do	you	on	hand	have?
How			do	you	on
			do you

Sentence 210) BLEU: 1 (1/1/1/1) ; 0.517 (0.7143/0.6667/0.6/0.25) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0 (1/0.5/0/0)

Source

��

�ݭn

�@

��

�Ǥl

�C

Ref 0

need

pair

pants.

Ref 1

pair

pants

what

need.

Ref 2

have

buy

pair

pants.

Ref 3

need

get

pair

pants.

Ref 4

need

some

pants.

Ref 5

need

some

trousers.

Ref 6

need

some

slacks.

Ref 7

I'd

pair

pants.

Ref 8

want

buy

some

pants.

Ref 9

I'm

looking

for

some

pants.

Ref 10

must

get

some

pants.

Ref 11

have

buy

some

trousers.

Ref 12

need

get

trousers.

Ref 13

need

pair

trousers.

Ref 14

need

some

trousers.

Ref 15

need

some

pants.

Output 0

need

pair

pants.

N-grams

I	need	a	pair	of	pants.
I	need	a	pair	of	pants.
I need		a pair		of pants.
I need a			pair of
I need a pair
	need a		pair of pants.
	need a pair
	need a pair of
		a pair of
		a pair of pants.

Output 1

need

pair

pants

N-grams

i	need	a	pair	of	pants	.
	need	a	pair	of	pants
	need a		pair of
	need a pair			of pants
	need a pair of
		a pair
		a pair of
			pair of pants

Output 2

need

pair

pants.

N-grams

I	need	a	pair	of	pants.
I	need	a	pair	of	pants.
I need		a pair		of pants.
I need a			pair of
I need a pair
	need a		pair of pants.
	need a pair
	need a pair of
		a pair of
		a pair of pants.

Output 3

need

pair

pants.

N-grams

I	need	a	pair	of	pants.
I	need	a	pair	of	pants.
I need		a pair		of pants.
I need a			pair of
I need a pair
	need a		pair of pants.
	need a pair
	need a pair of
		a pair of
		a pair of pants.

Output 4

need

pants.

N-grams

I	need	pants.
I	need	pants.
I need

Sentence 211) BLEU: 0 (0.4286/0/0/0) ; 0 (0.5714/0/0/0) ; 0 (0.4286/0/0/0) ; 0.4347 (0.7143/0.5/0.4/0.25) ; 0 (0.8333/0.4/0.25/0)

Source

��

�

�b

�X

��

�H

Ref 0

How

many

days

will

you

staying?

Ref 1

How

many

days

you

plan

staying?

Ref 2

How

many

days

will

you

staying?

Ref 3

How

long

you

plan

staying?

Ref 4

How

many

days

are

you

scheduled

stay?

Ref 5

How

many

days

are

you

going

stay

here?

Ref 6

How

many

days

you

plan

stay?

Ref 7

What

number

days

you

plan

stay?

Ref 8

How

many

days

are

you

staying?

Ref 9

How

many

days

will

your

stay

be?

Ref 10

How

long

are

you

going

stay

here?

Ref 11

How

many

days

are

you

planning

stay

here?

Ref 12

How

many

days

are

you

going

here

for?

Ref 13

How

many

days

will

the

length

your

stay

be?

Ref 14

How

many

days

you

plan

stay?

Ref 15

How

many

days

will

you

here?

Output 0

will

stay

few

days

longer?

N-grams

I	will	stay	a	few	days	longer?
	will	stay			days

Output 1

will

stay

days

how

many

N-grams

i	will	stay	days	how	many	?
	will	stay	days		many

Output 2

will

stay

few

days

longer?

N-grams

I	will	stay	a	few	days	longer?
	will	stay			days

Output 3

How

many

days

will

foolish?

N-grams

How	many	days	will	I	be	foolish?
How	many	days	will		be
How many		days will
How many days
How many days will
	many days
	many days will

Output 4

How

many

days

will

stay?

N-grams

How	many	days	I	will	stay?
How	many	days		will	stay?
How many
How many days
	many days

Sentence 212) BLEU: 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.5/0.2/0/0) ; 0 (0.3333/0/0/0)

Source

�

�@

�G

�ж�

�C

��

�

��

�C

Ref 0

Room

fourteen

twelve.

I'll

waiting.

Ref 1

Room

fourteen

twelve.

I'll

waiting

there.

Ref 2

room

fourteen

twelve.

I'll

there.

Ref 3

Room

fourteen

twelve.

I'll

waiting

there.

Ref 4

Room

one-four-one-two.

So,

I'll

waiting.

Ref 5

Room

number

one

thousand

four

hundred

and

twelve.

Then,

I'll

standing

by.

Ref 6

Room

number

one-four-twelve.

So,

I'll

here

waiting.

Ref 7

It's

room

number

fourteen

twelve.

I'll

wait

for

you

here.

Ref 8

I'm

room

number

fourteen

twelve.

I'll

here.

Ref 9

It's

room

number

fourteen

twelve.

This

where

I'll

waiting.

Ref 10

I'm

room

fourteen

twelve.

I'll

wait

for

you.

Ref 11

Room

number

fourteen

twelve.

I'm

waiting.

Ref 12

Fourteen

twelve.

I'll

wait

here.

Ref 13

I'm

room

fourteen

twelve.

will

waiting

here.

Ref 14

For

room

fourteen

twelve.

will

wait.

Ref 15

room

fourteen

twelve.

will

stand

by.

Output 0

Four

two

rooms.

can

wait.

N-grams

Four	two	rooms.	I	can	wait.
			I		wait.

Output 1

1412

will

wait

rooms

N-grams

1412	i	will	wait	rooms	.
		will	wait

Output 2

Room

1412.

will

wait.

N-grams

Room	1412.	I	will	wait.
Room		I	will	wait.
		I will
		I will wait.
			will wait.

Output 3

1412

rooms.

will

wait

for.

N-grams

1412	rooms.	I	will	wait	for.
		I	will	wait
		I will

Output 4

Four

two

rooms.

can

wait.

N-grams

Four	two	rooms.	I	can	wait.
			I		wait.

Sentence 213) BLEU: 0.8091 (0.8571/0.8333/0.8/0.75) ; 0 (0.5556/0.375/0.1429/0) ; 0.8091 (0.8571/0.8333/0.8/0.75) ; 0.4111 (0.75/0.5714/0.3333/0.2) ; 0.4111 (0.75/0.5714/0.3333/0.2)

Source

��

�

�b

�U

�@

��

�U��

�C

Ref 0

I'll

get

off

the

stop.

Ref 1

The

stop

where

I'll

get

off.

Ref 2

The

stop

mine.

Ref 3

stop

the

one.

Ref 4

I'll

get

out

the

stop.

Ref 5

The

stop

where

get

off.

Ref 6

The

stop

mine.

Ref 7

I'd

get

off

the

stop.

Ref 8

Let

off

the

stop,

please.

Ref 9

Please

drop

off

the

stop.

Ref 10

I'm

getting

off

the

stop.

Ref 11

The

stop

mine.

Ref 12

I'm

off

the

stop.

Ref 13

will

disembark

the

stop.

Ref 14

will

get

off

the

place.

Ref 15

will

get

out

the

stop.

Output 0

will

get

off

the

next.

N-grams

I	will	get	off	at	the	next.
I	will	get	off	at	the
I will		get off		at the
I will get			off at
I will get off
	will get		off at the
	will get off
	will get off at
		get off at
		get off at the

Output 1

will

get

off

the

station

N-grams

i	will	get	off	the	next	in	station	.
	will	get	off	the	next
	will get			the next
	will get off
		get off

Output 2

will

get

off

the

next.

N-grams

I	will	get	off	at	the	next.
I	will	get	off	at	the
I will		get off		at the
I will get			off at
I will get off
	will get		off at the
	will get off
	will get off at
		get off at
		get off at the

Output 3

will

get

off

the

station.

N-grams

I	will	get	off	in	the	next	station.
I	will	get	off		the	next
I will		get off			the next
I will get
I will get off
	will get
	will get off

Output 4

will

get

out

the

station.

N-grams

I	will	get	out	in	the	next	station.
I	will	get	out		the	next
I will		get out			the next
I will get
I will get out
	will get
	will get out

Sentence 214) BLEU: 0 (1/0.6/0.25/0) ; 0 (0.5/0/0/0) ; 0 (1/0.6/0.25/0) ; 0 (0.6667/0.375/0.1429/0) ; 0 (0.8333/0.2/0/0)

Source

��

�n

�A

��

�C

�A

�O

�H

Ref 0

I'm

fine,

thank

you.

And

you?

Ref 1

I'm

fine,thanks.

How

about

you?

Ref 2

I'm

doing

fine,

thank

you.

And,

how

are

you

doing?

Ref 3

I'm

doing

alright,

thank

you.

And,

how

about

you?

Ref 4

I'm

doing

just

fine,

thanks.

How

about

you?

Ref 5

I'm

doing

OK,

thanks.

What

about

you?

Ref 6

I'm

just

great,

thank

you.

And

how

are

you?

Ref 7

I'm

doing

well,

thanks.

How

about

you?

Ref 8

I'm

pretty

good,

thanks.

How

are

you

doing?

Ref 9

I've

been

doing

well.

How

have

you

been?

Ref 10

I'm

okay,

thanks.

You?

Ref 11

I'm

doing

fine,

thanks.

How

about

you?

Ref 12

I'm

very

well,

thanks.

What

about

yourself?

Ref 13

I'm

fine

thanks

you.

How

are

you?

Ref 14

Thanks

you,

doing

well.

And

are

you

well?

Ref 15

Thanks

you,

fine.

hope

you

are

fine

too.

Output 0

fine,

thank

you.

You?

N-grams

I	am	fine,	thank	you.	You?
I	am	fine,	thank	you.	You?
I am		fine, thank
		fine, thank you.
			thank you.

Output 1

thank

you

very

good

N-grams

i	am	,	thank	you	very	good	?
	am		thank	you	very

Output 2

fine,

thank

you.

You?

N-grams

I	am	fine,	thank	you.	You?
I	am	fine,	thank	you.	You?
I am		fine, thank
		fine, thank you.
			thank you.

Output 3

very

good

and

thank.

What

about

you?

N-grams

I	am	very	good	and	thank.	What	about	you?
I	am	very				What	about	you?
I am						What about
						What about you?
							about you?

Output 4

very

good,

thank.

You?

N-grams

I	am	very	good,	thank.	You?
I	am	very	good,		You?
I am

Sentence 215) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.4/0.25/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.4/0/0/0)

Source

�A

��

�Ȧ�

�䲼

��

�H

Ref 0

you

traveler's

checks?

Ref 1

you

take

traveler's

checks?

Ref 2

Are

traveler's

checks

alright?

Ref 3

Can

use

traveler's

checks

pay?

Ref 4

Can

pay

traveler's

check?

Ref 5

Can

use

traveler's

checks

pay?

Ref 6

Can

give

you

traveler's

checks

payment?

Ref 7

Can

pay

with

traveler's

checks?

Ref 8

Will

you

payment

traveler's

checks?

Ref 9

possible

pay

traveler's

checks?

Ref 10

Could

pay

traveler's

check?

Ref 11

May

use

traveler's

checks

pay?

Ref 12

okay

pay

with

traveler's

checks?

Ref 13

May

pay

traveler's

check?

Ref 14

possible

pay

traveler's

check?

Ref 15

Can

pay

with

traveler's

check?

Output 0

You

traveler's

checks?

N-grams

You	accept	traveler's	checks?
	accept	traveler's	checks?
	accept traveler's
	accept traveler's checks?
		traveler's checks?

Output 1

you

check

N-grams

you	accept	's	check	?
you	accept
you accept

Output 2

You

traveler's

checks?

N-grams

You	accept	traveler's	checks?
	accept	traveler's	checks?
	accept traveler's
	accept traveler's checks?
		traveler's checks?

Output 3

you

trip

check?

N-grams

Do	you	accept	trip	check?
Do	you	accept		check?
Do you
Do you accept
	you accept

Output 4

You

the

traller's

check?

N-grams

You	accept	the	traller's	check?
	accept			check?

Sentence 216) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.2/0/0/0) ; 1 (1/1/1/1) ; 0 (0.6/0.25/0/0) ; 0 (1/0.6667/0/0)

Source

��

�ϥ�

�ܢ��

��

�C

Ref 0

use

Nikonos

Ref 1

Nikonos

what

use.

Ref 2

make

use

Nikonos

Ref 3

using

Nikonos

Ref 4

I'm

using

Nikonos

Five.

Ref 5

I'm

utilizing

the

Nikonos

Five.

Ref 6

The

Nikonos

Five

what

I'm

using.

Ref 7

I'm

using

Nikonos

Ref 8

have

Nikonos

Ref 9

I've

got

Nikonos

Ref 10

I'm

using

Nikonos

Ref 11

Nikonos

what

I'm

using

now.

Ref 12

Nikonos

what

use

now.

Ref 13

have

Nikonos

Five.

Ref 14

swing

with

Nikonos

Five.

Ref 15

handle

Nikonos

Five.

Output 0

use

the

��.

N-grams

I	use	the	��.
I	use	the
I use

Output 1

use

nikonos

N-grams

i	use	nikonos	v	.
	use

Output 2

use

Nikonos

N-grams

I	use	a	Nikonos	V.
I	use	a	Nikonos	V.
I use		a Nikonos
I use a			Nikonos V.
I use a Nikonos
	use a
	use a Nikonos
	use a Nikonos V.
		a Nikonos V.

Output 3

use

the

�ܢ��

N-grams

I	use	the	�ܢ��	.
I	use	the
I use

Output 4

use

Nikonos

N-grams

I	use	Nikonos	V.
I	use	Nikonos	V.
I use		Nikonos V.

Sentence 217) BLEU: 1 (1/1/1/1) ; 0 (0.7143/0.5/0/0) ; 1 (1/1/1/1) ; 0 (0.7143/0.5/0.2/0) ; 0 (0.8333/0.6/0.25/0)

Source

��

�b

�ǲ�

��

�@

��

�@�a

�C

Ref 0

studying

writer.

Ref 1

writer

what

studying

become.

Ref 2

studying

become

writer.

Ref 3

studying

order

become

writer.

Ref 4

I'm

studying

that

can

writer.

Ref 5

I'm

taking

classes

order

writer.

Ref 6

I'm

studying

with

becoming

writer

mind.

Ref 7

I'm

undertaking

studies

become

writer.

Ref 8

I'm

studying

that

may

become

writer.

Ref 9

undergoing

studies

writer.

Ref 10

I'm

studying

become

writer.

Ref 11

studying

can

become

writer.

Ref 12

I'm

studying

because

want

become

writer.

Ref 13

studying

author.

Ref 14

learning

writer.

Ref 15

learning

become

writer.

Output 0

studying

become

writer.

N-grams

I	am	studying	to	become	a	writer.
I	am	studying	to	become	a	writer.
I am		studying to		become a
I am studying			to become		a writer.
I am studying to				become a writer.
	am studying		to become a
	am studying to
	am studying to become
		studying to become
		studying to become a
			to become a writer.

Output 1

studying

become

writer

N-grams

i	am	studying	become	a	writer	.
	am	studying	become	a	writer
	am studying		become a
				a writer

Output 2

studying

become

writer.

N-grams

I	am	studying	to	become	a	writer.
I	am	studying	to	become	a	writer.
I am		studying to		become a
I am studying			to become		a writer.
I am studying to				become a writer.
	am studying		to become a
	am studying to
	am studying to become
		studying to become
		studying to become a
			to become a writer.

Output 3

become

writer

the

learning.

N-grams

I	become	a	writer	in	the	learning.
I	become	a	writer	in
	become a		writer in
		a writer
		a writer in

Output 4

studying

into

writer.

N-grams

I	am	studying	into	a	writer.
I	am	studying		a	writer.
I am				a writer.
I am studying
	am studying

Sentence 218) BLEU: 0.9457 (1/1/1/0.8) ; 0 (0.625/0.2857/0.1667/0) ; 0.9457 (1/1/1/0.8) ; 0.4273 (0.875/0.5714/0.3333/0.2) ; 0 (0.5556/0.125/0/0)

Source

��

�t�~

�@

��

�A

�ҥH

��

�I

�C

Ref 0

have

another

appointment,

please

hurry.

Ref 1

Please

hurry

because

have

another

appointment.

Ref 2

have

plans

please

hurry.

Ref 3

I'm

rush,

could

you

please

hurry?

Ref 4

have

appointment

after

this

please

make

fast.

Ref 5

have

another

appointment

after

this,

hurry,

please.

Ref 6

I've

got

another

appointment

following

this

please

rush

it.

Ref 7

Please

hurry

because

have

another

appointment.

Ref 8

have

somewhere

soon,

could

you

please

make

rush?

Ref 9

I'd

appreciate

you

could

hurry

because

have

another

appointment.

Ref 10

have

another

engagement.

Please

hurry

up.

Ref 11

have

somewhere

else

after,

get

move

on.

Ref 12

Please

could

you

hurry,

have

another

appointment

next?

Ref 13

have

another

plan

please

rush.

Ref 14

have

another

appointment

please

hurry

up.

Ref 15

have

plans

please

hurry.

Output 0

have

another

appointment,

please

hurry

up.

N-grams

I	have	another	appointment,	so	please	hurry	up.
I	have	another	appointment,	so	please	hurry	up.
I have		another appointment,		so please		hurry up.
I have another			appointment, so		please hurry
I have another appointment,				so please hurry
	have another		appointment, so please
	have another appointment,			so please hurry up.
	have another appointment, so				please hurry up.
		another appointment, so
		another appointment, so please

Output 1

have

appointment

please

hurry

N-grams

i	have	appointment	,	so	please	hurry	.
	have	appointment		so	please	hurry
				so please
				so please hurry
					please hurry

Output 2

have

another

appointment,

please

hurry

up.

N-grams

I	have	another	appointment,	so	please	hurry	up.
I	have	another	appointment,	so	please	hurry	up.
I have		another appointment,		so please		hurry up.
I have another			appointment, so		please hurry
I have another appointment,				so please hurry
	have another		appointment, so please
	have another appointment,			so please hurry up.
	have another appointment, so				please hurry up.
		another appointment, so
		another appointment, so please

Output 3

have

besides

appointment,

please

hurry.

N-grams

I	have	besides	an	appointment,	so	please	hurry.
I	have		an	appointment,	so	please	hurry.
I have				appointment, so		please hurry.
				appointment, so please
				appointment, so please hurry.
					so please
					so please hurry.

Output 4

have

other

appointment,

therefore

please

bit

faster.

N-grams

I	have	other	appointment,	therefore	please	a	bit	faster.
I	have		appointment,		please	a
I have

Sentence 219) BLEU: 0 (0.6667/0.25/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.6667/0.25/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0)

Source

�A

��

�ⴣ�c

��

�S�x

�H

Ref 0

What

your

suitcases

look

like?

Ref 1

What

sort

suitcases

you

have?

Ref 2

Can

you

describe

your

suitcases?

Ref 3

How

would

you

describe

your

suitcases?

Ref 4

What

kind

suitcases

you

have?

Ref 5

What

type

suitcases

you

have?

Ref 6

What

are

your

suitcases

like?

Ref 7

What

sort

suitcases

were

they?

Ref 8

Could

you

describe

your

suitcases?

Ref 9

What

were

your

suitcases

like?

Ref 10

What

are

your

suitcases

like?

Ref 11

What

kind

suitcases

are

they?

Ref 12

What

kind

suitcases

you

have?

Ref 13

What

kind

suitcases

you

have?

Ref 14

Please

describe

the

appearance

your

suitcases.

Ref 15

What

sort

suitcases

you

have?

Output 0

What

you

have

the

characteristics

the

suitcase?

N-grams

What	do	you	have	the	characteristics	of	the	suitcase?
What	do	you		the		of
What do
	do you

Output 1

what

have

suitcase

characteristic

does

your

N-grams

what	have	suitcase	characteristic	does	your	?
					your

Output 2

What

you

have

the

characteristics

the

suitcase?

N-grams

What	do	you	have	the	characteristics	of	the	suitcase?
What	do	you		the		of
What do
	do you

Output 3

What

characteristic

does

your

suitcase

have?

N-grams

What	characteristic	does	your	suitcase	have?
What			your		have?

Output 4

What

characteristic

does

your

suitcase

have?

N-grams

What	characteristic	does	your	suitcase	have?
What			your		have?

Sentence 220) BLEU: 0 (0.6667/0.2/0/0) ; 0 (0.2/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.3333/0/0/0)

Source

��

�A

��

�@

�M

��s

�C

Ref 0

One

beer,

please.

Ref 1

I'd

one

beer,

please.

Ref 2

Another

beer,

please.

Ref 3

Please

get

another

beer.

Ref 4

Another

beer,

please.

Ref 5

Please

bring

another

beer.

Ref 6

I'll

have

another

beer,

please.

Ref 7

I'd

another

beer,

please.

Ref 8

Could

have

another

beer,

please?

Ref 9

Would

you

give

one

beer,

please?

Ref 10

I'll

have

one

beer.

Ref 11

Could

you

get

another

beer?

Ref 12

May

have

another

beer?

Ref 13

Another

beer,

please.

Ref 14

Please

give

another

beer.

Ref 15

would

another

beer.

Output 0

Please

have

another

cup

beer.

N-grams

Please	have	another	cup	of	beer.
Please	have	another			beer.
	have another

Output 1

another

beer

please

N-grams

another	beer	please	of	.
another

Output 2

Another

beer

please.

N-grams

Another	beer	please.
Another		please.

Output 3

Please

have

another

cup

beer.

N-grams

Please	have	another	cup	of	beer.
Please	have	another			beer.
	have another

Output 4

Please

again

come

glass

beer.

N-grams

Please	again	come	glass	of	beer.
Please					beer.

Sentence 221) BLEU: 0 (0.3333/0/0/0) ; 0 (0.6/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.7143/0.3333/0/0) ; 0 (0.3333/0/0/0)

Source

�o

�O

�C

��q

��

�H

Ref 0

this

low

calorie

meal?

Ref 1

this

meal

low

calorie

one?

Ref 2

this

meal

with

low

calories?

Ref 3

this

low

calorie

dish?

Ref 4

this

meal

low

calories?

Ref 5

this

meal

low

cal?

Ref 6

Are

there

many

calories

this

meal?

Ref 7

Would

this

meal

low

calorie?

Ref 8

Would

this

low-cal

meal?

Ref 9

this

meal

low

calories?

Ref 10

this

meal

low

calorie?

Ref 11

Does

this

meal

have

few

calories?

Ref 12

Could

you

tell

this

meal

low

calorie?

Ref 13

this

meal

low

calories?

Ref 14

Does

this

meal

have

few

calories?

Ref 15

this

reduced

calorie

meal?

Output 0

This

low-calorie

diet

it?

N-grams

This	is	a	low-calorie	diet	it?
	is	a

Output 1

this

the

low

N-grams

this	is	the	low	?
this	is		low

Output 2

This

low-calorie

diet

it?

N-grams

This	is	a	low-calorie	diet	it?
	is	a

Output 3

this

the

meal

low

calories?

N-grams

Is	this	the	meal	of	low	calories?
Is	this		meal		low	calories?
Is this					low calories?

Output 4

This

the

low

thermal

meals?

N-grams

This	is	the	low	thermal	meals?
	is		low

Sentence 222) BLEU: 1 (1/1/1/1) ; 0 (0.6667/0/0/0) ; 0 (0.25/0/0/0) ; 1 (1/1/1/1) ; 0 (0.6/0.25/0/0)

Source

�A

�{�b

�b

��

�H

Ref 0

What

are

you

doing

now?

Ref 1

What

are

you

now?

Ref 2

What

are

you

doing

right

now?

Ref 3

What's

up?

Ref 4

What

are

you

right

now?

Ref 5

What

are

you

involved

the

moment?

Ref 6

What

are

you

engaged

right

now?

Ref 7

What

are

you

these

days?

Ref 8

What

have

you

been

lately?

Ref 9

How

you

spend

your

time

these

days?

Ref 10

What

are

you

right

now?

Ref 11

Tell

what

you're

to.

Ref 12

I'd

know

what

you're

doing.

Ref 13

What

are

you

doing

this

moment?

Ref 14

What

are

you

now?

Ref 15

What

are

you

into

now?

Output 0

What

are

you

doing

now?

N-grams

What	are	you	doing	now?
What	are	you	doing	now?
What are		you doing
What are you			doing now?
What are you doing
	are you
	are you doing
	are you doing now?
		you doing now?

Output 1

you

are

now

doing

what

N-grams

you	are	now	doing	what	?
you	are		doing	what

Output 2

You

are

now

doing?

N-grams

You	are	now	doing?
	are

Output 3

What

are

you

doing

now?

N-grams

What	are	you	doing	now?
What	are	you	doing	now?
What are		you doing
What are you			doing now?
What are you doing
	are you
	are you doing
	are you doing now?
		you doing now?

Output 4

What

now

are

you

making?

N-grams

What	now	are	you	making?
What		are	you
		are you

Sentence 223) BLEU: 0 (0.1667/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.1667/0/0/0)

Source

��

�L

��

�Q

��

�C

Ref 0

Early

fifties.

Ref 1

her

early

fifties.

Ref 2

She

her

early

fifties.

Ref 3

She's

still

her

early

fifties.

Ref 4

Just

over

fifty.

Ref 5

Fifty-something.

Ref 6

little

over

fifty.

Ref 7

She's

her

early

fifties.

Ref 8

Just

over

fifty.

Ref 9

Fifty

so.

Ref 10

She's

her

early

fifties.

Ref 11

the

right

side

fifty.

Ref 12

She's

not

much

than

fifty.

Ref 13

She

her

early

fifties.

Ref 14

She

fifty-something.

Ref 15

the

early

half

her

fifties.

Output 0

Just

crossed

five

ten

years

old.

N-grams

Just	crossed	five	ten	years	old.
Just

Output 1

just

years

old

N-grams

just

years

old

Output 2

Right

after

the

50-year-old.

N-grams

Right	after	the	50-year-old.
		the

Output 3

Just

leading

years

old.

N-grams

Just	leading	is	50	years	old.
Just		is

Output 4

Just

crossed

five

ten

years

old.

N-grams

Just	crossed	five	ten	years	old.
Just

Sentence 224) BLEU: 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.3333/0.2/0/0) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.8333/0.6/0.25/0) ; 0 (0.2/0/0/0)

Source

��

�b

�o

�e

�@

��

�a��

�C

Ref 0

Please

draw

map

here.

Ref 1

Please

draw

map

here.

Ref 2

Please

draw

map

right

here.

Ref 3

Please

make

map

here.

Ref 4

Please

sketch

the

map

right

here.

Ref 5

Please

outline

map

here.

Ref 6

Would

you

draw

map

here?

Ref 7

Could

you

make

map

here?

Ref 8

Would

you

mind

drawing

map

here?

Ref 9

Could

you

draw

map

here?

Ref 10

Would

you

mind

drawing

map

here?

Ref 11

Kindly

draw

map

here.

Ref 12

Could

you

draw

map

here?

Ref 13

Could

you

draw

some

directions

here?

Ref 14

Please

draw

simple

map

here?

Ref 15

Please

draw

map

here.

Output 0

Please

draw

map

this.

N-grams

Please	draw	a	map	in	this.
Please	draw	a	map
Please draw		a map
Please draw a
Please draw a map
	draw a
	draw a map

Output 1

please

map

this

N-grams

please	a	map	in	this	.
	a	map
	a map

Output 2

Please

draw

map

this.

N-grams

Please	draw	a	map	in	this.
Please	draw	a	map
Please draw		a map
Please draw a
Please draw a map
	draw a
	draw a map

Output 3

Please

make

uniform

map

here.

N-grams

Please	make	uniform	a	map	here.
Please	make		a	map	here.
Please make			a map
			a map here.
				map here.

Output 4

Please

this

picture

map.

N-grams

Please	in	this	picture	map.
Please

Sentence 225) BLEU: 0.4317 (0.7778/0.625/0.4286/0.1667) ; 0 (0.5556/0.5/0.2857/0) ; 0.4317 (0.7778/0.625/0.4286/0.1667) ; 0.5721 (0.8571/0.8333/0.6/0.25) ; 0 (0.7143/0.3333/0/0)

Source

��

�̫�

�@

��

�C

Ref 0

The

one

the

left

end,

please.

Ref 1

Please

give

the

one

the

left

end.

Ref 2

I'd

the

one

the

left

end.

Ref 3

That

one

the

left

end,

please.

Ref 4

I'd

the

one

the

left

end,

please.

Ref 5

The

one

the

end

the

left

side,

please.

Ref 6

Please

give

the

one

the

far

left

end.

Ref 7

That

one

the

left

side,

please.

Ref 8

Could

you

get

the

one

the

left

end,

please?

Ref 9

I'd

the

one

the

left

end,

please.

Ref 10

I'd

the

one

the

far

left.

Ref 11

Kindly

get

the

one

towards

the

left.

Ref 12

Could

you

get

the

one

over

the

left?

Ref 13

would

the

one

the

left

side,

please.

Ref 14

would

the

one

the

left

side

the

end,

please.

Ref 15

would

the

left

most

one

please.

Output 0

Please

give

the

left

side

the

last.

N-grams

Please	give	me	the	left	side	of	the	last.
Please	give	me	the	left	side		the
Please give		me the		left side
Please give me			the left
Please give me the
	give me		the left side
	give me the

Output 1

please

give

the

left

side

last

N-grams

please	give	me	the	left	side	of	last	.
	give	me	the	left	side
	give me		the left
	give me the			left side
		me the
			the left side

Output 2

Please

give

the

left

side

the

last.

N-grams

Please	give	me	the	left	side	of	the	last.
Please	give	me	the	left	side		the
Please give		me the		left side
Please give me			the left
Please give me the
	give me		the left side
	give me the

Output 3

Please

give

the

left

side

last.

N-grams

Please	give	me	the	left	side	last.
Please	give	me	the	left	side
Please give		me the		left side
Please give me			the left
Please give me the
	give me		the left side
	give me the

Output 4

Please

give

left

side

last.

N-grams

Please	give	left	side	of	me	last.
Please	give	left	side		me
Please give		left side

Sentence 226) BLEU: 0 (0.75/0.1429/0/0) ; 0 (0.5714/0.1667/0/0) ; 0 (0.6/0/0/0) ; 0 (0.75/0.1429/0/0) ; 0 (0.2/0/0/0)

Source

�b

�U

�@

��

��f

�k

��

�C

Ref 0

Turn

right

the

corner.

Ref 1

the

corner,

hang

right.

Ref 2

Hang

right

the

corner.

Ref 3

Make

right

hand

turn

the

corner.

Ref 4

Make

right

the

corner.

Ref 5

Take

right

the

corner.

Ref 6

Hang

right

the

corner.

Ref 7

Take

right

the

corner.

Ref 8

right

the

corner.

Ref 9

Right

the

corner.

Ref 10

Take

right

the

corner.

Ref 11

Right

the

corner.

Ref 12

Turn

your

right

the

corner.

Ref 13

Make

right

the

corner.

Ref 14

Right

the

corner.

Ref 15

right

the

corner.

Output 0

Turn

the

right

street

corner.

N-grams

Turn	to	the	right	in	next	street	corner.
Turn	to	the	right		next		corner.
Turn to

Output 1

the

turn

right

street

N-grams

the	next	turn	right	in	street	.
the	next	turn	right
the next

Output 2

The

junction

turn

right.

N-grams

The	next	junction	turn	right.
	next		turn	right.

Output 3

Turn

the

right

street

corner.

N-grams

Turn	to	the	right	in	next	street	corner.
Turn	to	the	right		next		corner.
Turn to

Output 4

street

intersection

right-turn.

N-grams

In	next	street	intersection	right-turn.
	next

Sentence 227) BLEU: 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.4/0.25/0/0) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.8/0.5/0.3333/0)

Source

�o

��O

��

�I

��

�C

Ref 0

This

not

what

ordered.

Ref 1

This

not

the

same

thing

ordered.

Ref 2

didn't

order

this.

Ref 3

ordered

something

different.

Ref 4

This

different

than

what

ordered.

Ref 5

This

not

the

same

what

ordered.

Ref 6

This

does

not

match

order.

Ref 7

did

not

order

this.

Ref 8

This

isn't

what

asked

for.

Ref 9

asked

for

something

else.

Ref 10

This

not

what

wanted.

Ref 11

This

not

order.

Ref 12

It's

different

from

what

ordered.

Ref 13

This

different

from

what

ordered.

Ref 14

didn't

order

this.

Ref 15

didn't

ask

for

this.

Output 0

This

isn't

what

order.

N-grams

This	isn't	what	I	order.
This	isn't	what	I	order.
This isn't		what I
This isn't what
This isn't what I
	isn't what
	isn't what I

Output 1

this

not

N-grams

this	is	not	i	.
	is	not
	is not

Output 2

This

not

point.

N-grams

This	is	not	my	point.
This	is	not	my
This is		not my
This is not
This is not my
	is not
	is not my

Output 3

This

isn't

what

order.

N-grams

This	isn't	what	I	order.
This	isn't	what	I	order.
This isn't		what I
This isn't what
This isn't what I
	isn't what
	isn't what I

Output 4

This

not

selects.

N-grams

This	is	not	I	selects.
This	is	not	I
This is
This is not
	is not

Sentence 228) BLEU: 1 (1/1/1/1) ; 0 (0.3333/0/0/0) ; 1 (1/1/1/1) ; 0 (0.6667/0.5/0/0) ; 0 (0.6667/0.5/0/0)

Source

�h��

��

�H

Ref 0

How

much?

Ref 1

How

much

it?

Ref 2

How

much

does

cost?

Ref 3

How

much

for

it?

Ref 4

What's

the

cost?

Ref 5

What's

the

price?

Ref 6

What's

the

amount?

Ref 7

How

much

does

cost?

Ref 8

How

much

will

that

be?

Ref 9

What's

the

cost?

Ref 10

How

much

does

cost?

Ref 11

What

does

cost?

Ref 12

What's

the

price?

Ref 13

How

much

it?

Ref 14

What's

the

price?

Ref 15

How

much

does

cost?

Output 0

How

much

it?

N-grams

How	much	is	it?
How	much	is	it?
How much		is it?
How much is
How much is it?
	much is
	much is it?

Output 1

how

much

N-grams

how	much	?
	much

Output 2

How

much

it?

N-grams

How	much	is	it?
How	much	is	it?
How much		is it?
How much is
How much is it?
	much is
	much is it?

Output 3

How

much

N-grams

How	much	?
How	much
How much

Output 4

How

much

money?

N-grams

How	much	money?
How	much
How much

Sentence 229) BLEU: 0.6493 (0.9167/0.7273/0.6/0.4444) ; 0 (0.6/0.3333/0.125/0) ; 0.4463 (0.8889/0.625/0.4286/0.1667) ; 0.6493 (0.9167/0.7273/0.6/0.4444) ; 0 (0.375/0.1429/0/0)

Source

�A

��

�b

��

�b

�h�[

�H

Ref 0

How

long

are

you

going

stay

the

United

States?

Ref 1

How

long

will

you

the

U.S.?

Ref 2

How

long

you

plan

stay

the

U.S.?

Ref 3

How

long

will

your

stay

the

U.S.

be?

Ref 4

How

long

you

plan

stay

the

U.S.?

Ref 5

How

long

are

you

planning

stay

America?

Ref 6

What's

your

intended

length

stay

the

U.S.?

Ref 7

How

long

you

intend

stay

the

U.S.?

Ref 8

What

length

time

you

plan

spend

the

United

States?

Ref 9

What

your

intended

length

stay

the

United

States?

Ref 10

How

long

are

you

staying

the

States?

Ref 11

How

long

will

you

the

U.S.?

Ref 12

How

long

are

you

planning

stay

America?

Ref 13

How

long

you

plan

stay

the

United

States?

Ref 14

How

long

will

you

the

United

States?

Ref 15

For

what

duration

will

you

the

United

States?

Output 0

How

long

you

intend

foolish

the

United

States?

N-grams

How	long	do	you	intend	to	be	foolish	in	the	United	States?
How	long	do	you	intend	to	be		in	the	United	States?
How long		do you		intend to				in the		United States?
How long do			you intend					in the United
How long do you								in the United States?
	long do		you intend to						the United
	long do you								the United States?
	long do you intend
		do you intend
		do you intend to

Output 1

you

intend

long

the

united

states

how

N-grams

you	intend	to	long	in	the	united	states	how	?
you	intend	to	long	in	the
you intend				in the
you intend to
	intend to

Output 2

You

intend

stay

long

the

United

States?

N-grams

You	intend	to	stay	long	in	the	United	States?
	intend	to	stay	long	in	the	United	States?
	intend to				in the		United States?
	intend to stay				in the United
		to stay			in the United States?
						the United
						the United States?

Output 3

How

long

you

intend

foolish

the

United

States?

N-grams

How	long	do	you	intend	to	be	foolish	in	the	United	States?
How	long	do	you	intend	to	be		in	the	United	States?
How long		do you		intend to				in the		United States?
How long do			you intend					in the United
How long do you								in the United States?
	long do		you intend to						the United
	long do you								the United States?
	long do you intend
		do you intend
		do you intend to

Output 4

You

planned

how

long

stays

the

US?

N-grams

You	planned	how	long	stays	in	the	US?
			long		in	the
					in the

Sentence 230) BLEU: 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0)

Source

��b

��s

�C

Ref 0

Studying.

Ref 1

For

Studying.

Ref 2

School.

Ref 3

I'll

studying.

Ref 4

study.

Ref 5

I'm

here

studying.

Ref 6

study.

Ref 7

I'm

here

student.

Ref 8

I'm

studying.

Ref 9

I'm

student.

Ref 10

study.

Ref 11

here

study

foreign

student.

Ref 12

study.

Ref 13

attend

school.

Ref 14

Studying.

Ref 15

Studying.

Output 0

studying.

N-grams

It	is	studying.
		studying.

Output 1

studying

N-grams

studying

Output 2

Being

studied.

N-grams

Being

studied.

Output 3

studying.

N-grams

It	is	studying.
		studying.

Output 4

studying.

N-grams

Is	studying.
	studying.

Sentence 231) BLEU: 0 (0.2857/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.2857/0/0/0)

Source

U�P

��

�H

Ref 0

What

about

week?

Ref 1

How

about

week?

Ref 2

How

would

week

be?

Ref 3

How

does

week

sound?

Ref 4

How

about

week?

Ref 5

What

would

you

say

week?

Ref 6

week,

then?

Ref 7

How

about

week?

Ref 8

What's

week

for

you?

Ref 9

week

okay

for

you?

Ref 10

Shall

make

week?

Ref 11

What

you

think

about

week?

Ref 12

How

about

week?

Ref 13

How

about

week?

Ref 14

How

week

for

you?

Ref 15

How

does

week

sound?

Output 0

week

will

what

kind

of?

N-grams

Next	week	will	be	what	kind	of?
Next	week

Output 1

week

how

N-grams

next	week	how	?
next	week
next week

Output 2

week,

how

to?

N-grams

Next	week,	how	to?
Next	week,
Next week,

Output 3

week

how?

N-grams

Next	week	how?
Next	week

Output 4

week

will

what

kind

of?

N-grams

Next	week	will	be	what	kind	of?
Next	week

Sentence 232) BLEU: 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6/0/0/0) ; 0 (0.6/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�ݭn

�j��

�Q

��

�C

Ref 0

takes

about

fifteen

minutes.

Ref 1

takes

approximately

fifteen

minutes.

Ref 2

Fifteen

minutes

about

how

long

takes.

Ref 3

Fifteen

minutes

about

the

time

that

takes.

Ref 4

It'll

require

about

fifteen

minutes.

Ref 5

takes

about

quarter

hour.

Ref 6

You

have

spend

about

fifteen

minutes.

Ref 7

It'll

take

approximately

fifteen

minutes.

Ref 8

It's

about

fifteen

minutes.

Ref 9

Approximately

fifteen

minutes.

Ref 10

Fifteen

minutes

around

about

the

time

takes.

Ref 11

The

time

taken

about

fifteen

minutes.

Ref 12

The

trip

takes

less

fifteen

minutes.

Ref 13

takes

approximately

fifteen

minutes.

Ref 14

will

take

approximately

fifteen

minutes.

Ref 15

will

approximately

fifteen

minutes.

Output 0

needs

about

ten

five

minutes.

N-grams

It	needs	about	ten	five	minutes.
It		about			minutes.

Output 1

needs

minutes

about

N-grams

it	needs	15	minutes	about	.
it			minutes	about

Output 2

needs

around

minutes.

N-grams

It	needs	around	15	minutes.
It		around		minutes.

Output 3

needs

about

minutes.

N-grams

It	needs	about	15	minutes.
It		about		minutes.

Output 4

needs

about

ten

five

minutes.

N-grams

It	needs	about	ten	five	minutes.
It		about			minutes.

Sentence 233) BLEU: 0 (0.4615/0.1667/0.09091/0) ; 0 (0.5/0/0/0) ; 0 (0.5556/0.25/0/0) ; 0 (0.4615/0.1667/0.09091/0) ; 0 (0.5625/0.2/0.07143/0)

Source

��

�Q�n

��u

�A��

�b

�Q��

��

�Z

�W

�s�i

��

¾��

�C

Ref 0

I'd

apply

for

the

position

you

advertised

yesterday's

Post.

Ref 1

I'd

apply

for

the

position

you

advertised

yesterday's

newspaper.

Ref 2

want

apply

for

the

position

you

had

advertised

yesterday

the

newspaper.

Ref 3

want

apply

for

your

help-wanted

yesterday's

paper.

Ref 4

would

apply

for

the

job

advertised

the

paper

yesterday.

Ref 5

I'd

put

application

for

the

position

yesterday's

classifieds.

Ref 6

would

submit

application

for

the

position

that

was

the

classifieds

yesterday's

newspaper.

Ref 7

want

submit

application

for

the

position

advertised

yesterday's

paper.

Ref 8

Could

apply

for

the

position

posted

yesterday's

paper?

Ref 9

I'm

hoping

respond

the

posting

yesterday's

paper.

Ref 10

was

wondering

could

apply

for

the

position

advertised

yesterday's

paper.

Ref 11

interested

the

job

advertised

the

paper

yesterday.

Ref 12

want

apply

for

the

job

advertised

yesterday's

paper.

Ref 13

interested

the

position

that

was

advertised

yesterday's

newspaper.

Ref 14

wish

apply

for

the

job

that

was

advertised

the

paper

yesterday.

Ref 15

would

apply

for

the

job

that

was

yesterday's

newspaper.

Output 0

want

appointment

you

the

post

yesterday's

periodical

advertisement.

N-grams

want

appointment

you

the

post

yesterday's

periodical

advertisement.

want

you

the

yesterday's

I want

I want to

want to

Output 1

want

yesterday

post

you

the

periodical

N-grams

i	want	in	yesterday	's	post	to	you	the	periodical	advertisement	.
	want	in	yesterday			to	you	the

Output 2

want

your

candidate

yesterday's

journal

post

ads.

N-grams

I	want	your	candidate	in	yesterday's	journal	post	ads.
I	want	your		in	yesterday's
I want				in yesterday's

Output 3

want

appointment

you

the

post

yesterday's

periodical

advertisement.

N-grams

want

appointment

you

the

post

yesterday's

periodical

advertisement.

want

you

the

yesterday's

I want

I want to

want to

Output 4

wanted

respond

call

for

recruits

you

yesterday's

periodical

the

position.

N-grams

wanted

respond

call

for

recruits

you

yesterday's

periodical

the

position.

respond

for

you

yesterday's

the

to respond

in yesterday's

to respond to

respond to

Sentence 234) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��}

�C

Ref 0

Get

away.

Ref 1

away.

Ref 2

Leave

alone.

Ref 3

Stay

away

from

me.

Ref 4

Get

out

here.

Ref 5

Get

lost.

Ref 6

Leave

alone.

Ref 7

Get

out

sight.

Ref 8

Out

sight.

Ref 9

away.

Ref 10

Scram.

Ref 11

Get

out

here.

Ref 12

Beat

it.

Ref 13

Leave

alone.

Ref 14

Disappear.

Ref 15

Get

lost.

Output 0

Leave.

N-grams

Leave.

Output 1

N-grams

Output 2

離開.

N-grams

離開.

Output 3

Leave.

N-grams

Leave.

Output 4

Departure.

N-grams

Departure.

Sentence 235) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.25/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (1/0.5/0/0) ; 0 (0.75/0/0/0)

Source

��

��q��

�C

Ref 0

Please

call

doctor.

Ref 1

Please

get

doctor.

Ref 2

Please

call

for

doctor.

Ref 3

Please

call

doctor.

Ref 4

Please

get

doctor.

Ref 5

Please

summon

doctor.

Ref 6

Please

phone

doctor.

Ref 7

Could

you

call

doctor,

please?

Ref 8

Send

for

doctor,

please.

Ref 9

Get

doctor.

Ref 10

Would

you

mind

calling

for

doctor?

Ref 11

would

see

doctor.

Ref 12

I'd

you

call

doctor.

Ref 13

Please

contact

doctor.

Ref 14

Please

contact

physician.

Ref 15

Please

get

doctor.

Output 0

Please

call

the

doctor.

N-grams

Please	call	the	doctor.
Please	call		doctor.
Please call

Output 1

please

call

doctor

N-grams

please	call	doctor	.
	call

Output 2

Please

call

the

doctor.

N-grams

Please	call	the	doctor.
Please	call		doctor.
Please call

Output 3

Please

call

doctor.

N-grams

Please	call	doctor.
Please	call	doctor.
Please call

Output 4

Please

telephone

doctor.

N-grams

Please	telephone	to	doctor.
Please		to	doctor.

Sentence 236) BLEU: 1 (1/1/1/1) ; 0 (0.4286/0.1667/0/0) ; 1 (1/1/1/1) ; 0 (0.5/0.2/0/0) ; 0 (0.5714/0.1667/0/0)

Source

��

�@

��

�P

�F

�C

Ref 0

have

loose

tooth.

Ref 1

tooth

loose.

Ref 2

have

tooth

that

loose.

Ref 3

have

tooth

that

has

come

loose.

Ref 4

tooth

wiggly.

Ref 5

tooth

moving

around.

Ref 6

tooth

loose.

Ref 7

tooth

loose.

Ref 8

This

tooth

mine

loose.

Ref 9

I've

got

loose

tooth.

Ref 10

tooth

wobbly.

Ref 11

One

teeth

loose.

Ref 12

I've

got

wobbly

tooth.

Ref 13

tooth

loose.

Ref 14

One

teeth

loose.

Ref 15

One

teeth

wobbly.

Output 0

have

loose

tooth.

N-grams

I	have	a	loose	tooth.
I	have	a	loose	tooth.
I have		a loose
I have a			loose tooth.
I have a loose
	have a
	have a loose
	have a loose tooth.
		a loose tooth.

Output 1

loose

tooth

had

N-grams

i	a	loose	tooth	had	to	.
	a	loose	tooth
	a loose

Output 2

have

loose

tooth.

N-grams

I	have	a	loose	tooth.
I	have	a	loose	tooth.
I have		a loose
I have a			loose tooth.
I have a loose
	have a
	have a loose
	have a loose tooth.
		a loose tooth.

Output 3

had

tooth

loosen.

N-grams

I	had	a	tooth	to	loosen.
I		a	tooth
		a tooth

Output 4

had

tooth

loose.

N-grams

I	had	a	tooth	to	be	loose.
I		a	tooth			loose.
		a tooth

Sentence 237) BLEU: 1 (1/1/1/1) ; 0 (0.6667/0.6/0.25/0) ; 1 (1/1/1/1) ; 0.7071 (1/1/0.75/0.3333) ; 0 (0.75/0.3333/0/0)

Source

��

�Q

��

�@

��

�C

Ref 0

I'd

see

doctor.

Ref 1

want

see

doctor.

Ref 2

want

looked

doctor.

Ref 3

want

doctor

examine

me.

Ref 4

I'd

talk

doctor.

Ref 5

I'd

consult

with

physician.

Ref 6

I'd

meet

with

doctor.

Ref 7

want

doctor

examine

me.

Ref 8

I'm

hoping

doctor

could

see

me.

Ref 9

wish

examined

doctor.

Ref 10

want

doctor

examine

me.

Ref 11

seeking

doctor's

advice.

Ref 12

would

consult

doctor.

Ref 13

wish

examined

doctor.

Ref 14

wish

examined

physician.

Ref 15

would

consult

doctor.

Output 0

want

see

doctor.

N-grams

I	want	to	see	a	doctor.
I	want	to	see	a	doctor.
I want		to see		a doctor.
I want to			see a
I want to see
	want to		see a doctor.
	want to see
	want to see a
		to see a
		to see a doctor.

Output 1

see

doctor

N-grams

i	to	see	a	doctor	.
	to	see	a	doctor
	to see		a doctor
	to see a
		see a

Output 2

want

see

doctor.

N-grams

I	want	to	see	a	doctor.
I	want	to	see	a	doctor.
I want		to see		a doctor.
I want to			see a
I want to see
	want to		see a doctor.
	want to see
	want to see a
		to see a
		to see a doctor.

Output 3

wish

see

doctor.

N-grams

I	wish	to	see	a	doctor.
I	wish	to	see	a	doctor.
I wish		to see		a doctor.
I wish to			see a
	wish to		see a doctor.
		to see a
		to see a doctor.

Output 4

infer

doctor.

N-grams

I	infer	a	doctor.
I		a	doctor.
		a doctor.

Sentence 238) BLEU: 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�j�n

��

�C

Ref 0

Please

say

loud

voice.

Ref 1

Please

speak

loud

voice.

Ref 2

Please

use

loud

voice

when

you

speak.

Ref 3

Please

speak

loudly.

Ref 4

Please

speak

when

you

say

it.

Ref 5

Please

raise

your

voice

when

you

say

it.

Ref 6

Please

say

loudly.

Ref 7

Would

you

please

speak

louder?

Ref 8

Speak

louder,

please.

Ref 9

Could

you

say

louder

voice,

please?

Ref 10

Speak

up.

Ref 11

Would

you

mind

speaking

loud

voice?

Ref 12

would

you

speak

up.

Ref 13

Please

say

loudly.

Ref 14

Please

say

louder.

Ref 15

Please

project

your

voice

more.

Output 0

Please

saying.

N-grams

Please	saying.
Please

Output 1

please

loudly

say

N-grams

please	loudly	say	.
please		say

Output 2

Please

saying.

N-grams

Please	saying.
Please

Output 3

Please

loudly

say.

N-grams

Please	loudly	say.
Please

Output 4

Please

loudly

say.

N-grams

Please	loudly	say.
Please

Sentence 239) BLEU: 0 (0.5/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.4/0/0/0)

Source

��

�R�~

�o��

��

�C

Ref 0

Please

develop

these

rolls

film.

Ref 1

want

these

rolls

film

developed,

please.

Ref 2

Please

develop

this

film.

Ref 3

want

have

this

film

developed,

please.

Ref 4

Could

you

please

develop

this

film?

Ref 5

I'd

have

this

film

developed,

please.

Ref 6

I'd

get

this

film

developed.

Ref 7

Could

you

develop

this

film,

please?

Ref 8

I'd

these

rolls

film

developed,

please.

Ref 9

Could

have

these

rolls

film

developed,

please?

Ref 10

I'd

you

develop

these

rolls

film.

Ref 11

Could

you

have

these

rolls

film

developed

for

me?

Ref 12

These

rolls

film

need

developing.

Ref 13

Please

develop

this

film.

Ref 14

would

this

film

developed,

please.

Ref 15

Would

you

develop

this

film,

please.

Output 0

Please

rinse

these

films.

N-grams

Please	rinse	these	films.
Please		these

Output 1

please

these

films

flush

N-grams

please	these	films	flush	.
please	these

Output 2

Please

rinse

these

films.

N-grams

Please	rinse	these	films.
Please		these

Output 3

Please

flush

these.

N-grams

Please	flush	these.
Please

Output 4

Please

flush

these

roll

films.

N-grams

Please	flush	these	roll	films.
Please		these

Sentence 240) BLEU: 0 (1/1/1/0) ; 0 (0.75/0/0/0) ; 0 (1/1/1/0) ; 0 (0.75/0.3333/0/0) ; 0 (1/1/1/0)

Source

�L��

�O

��

�H

Ref 0

Who

are

they?

Ref 1

Who

are

those

people?

Ref 2

Who's

that?

Ref 3

Who

are

those

people?

Ref 4

Who

it?

Ref 5

Who

are

those

people?

Ref 6

you

know

who

they

are?

Ref 7

Who

would

they

be?

Ref 8

I'd

know

who

they

are.

Ref 9

Please

tell

who

there

are.

Ref 10

Who

are

those

people?

Ref 11

you

know

who

they

are?

Ref 12

Who

are

they?

Ref 13

Who

are

they?

Ref 14

Who

are

they?

Ref 15

Who

are

they?

Output 0

Who

are

they?

N-grams

Who	are	they?
Who	are	they?
Who are
Who are they?
	are they?

Output 1

who

are

they

N-grams

who	are	they	?
who	are	they

Output 2

Who

are

they?

N-grams

Who	are	they?
Who	are	they?
Who are
Who are they?
	are they?

Output 3

Who

are

they

N-grams

Who	are	they	?
Who	are	they
Who are

Output 4

Who

are

they?

N-grams

Who	are	they?
Who	are	they?
Who are
Who are they?
	are they?

Sentence 241) BLEU: 0 (0.8/0.25/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.8/0.25/0/0) ; 0 (0.8571/0.1667/0/0) ; 0 (0.8/0.5/0/0)

Source

��

�Pı

��I

�w

�t

�C

Ref 0

feel

dizzy.

Ref 1

feeling

dizzy.

Ref 2

having

dizzy

spell.

Ref 3

I'm

suffering

from

dizziness.

Ref 4

I'm

experiencing

dizziness.

Ref 5

I'm

getting

dizzy.

Ref 6

I'm

feeling

dizzy.

Ref 7

feel

faint.

Ref 8

I'm

feeling

light-headed.

Ref 9

think

might

pass

out.

Ref 10

I'm

little

light-headed.

Ref 11

feel

faint.

Ref 12

head

spinning.

Ref 13

dizzy.

Ref 14

feeling

woozy.

Ref 15

feeling

dizzy.

Output 0

feel

bit

dizzy.

N-grams

I	feel	a	bit	dizzy.
I	feel	a		dizzy.
I feel

Output 1

feel

little

N-grams

i	feel	a	little	.
	feel	a	little
		a little

Output 2

feel

bit

dizzy.

N-grams

I	feel	a	bit	dizzy.
I	feel	a		dizzy.
I feel

Output 3

feeling

has

little

faint.

N-grams

My	feeling	has	a	little	a	faint.
My	feeling		a	little		faint.
			a little

Output 4

feel

little

dizzily.

N-grams

I	feel	a	little	dizzily.
I	feel	a	little
I feel		a little

Sentence 242) BLEU: 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.5714/0/0/0) ; 0.4347 (0.7143/0.5/0.4/0.25) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.5/0.2/0/0)

Source

�

�A

��O

��

�E��

�C

Ref 0

No,

you

don't

have

transfer.

Ref 1

No,

there

need

transfer.

Ref 2

No,

there

transfer.

Ref 3

No,

you

don't

have

transfer.

Ref 4

No,

you

don't

need

change.

Ref 5

No,

you

don't

need

transfer.

Ref 6

No,

there's

need

transfer.

Ref 7

No,

it's

not

necessary

for

you

transfer.

Ref 8

No,

you

won't

need

transfer.

Ref 9

No,

transferring

will

not

necessary.

Ref 10

No,

it's

not

necessary

transfer.

Ref 11

No,

transfer

not

necessary.

Ref 12

No,

there's

need

transfer.

Ref 13

No,

you

not

have

change

another

train.

Ref 14

No,

you

not

need

change

another

train.

Ref 15

No,

isn't

necessary

transfer.

Output 0

Not,

you

don't

have

move.

N-grams

Not,	you	don't	have	to	move.
	you	don't	have	to
	you don't		have to
	you don't have
	you don't have to
		don't have
		don't have to

Output 1

you

not

move

N-grams

no	,	you	not	to	move	.
no		you	not	to

Output 2

No,

You

not

need

move.

N-grams

No,	You	do	not	need	to	move.
No,		do	not	need	to
		do not		need to
		do not need
		do not need to
			not need
			not need to

Output 3

Not,

you

don't

have

move.

N-grams

Not,	you	don't	have	to	move.
	you	don't	have	to
	you don't		have to
	you don't have
	you don't have to
		don't have
		don't have to

Output 4

No,

you

are

not

must

migrate.

N-grams

No,	you	are	not	must	migrate.
No,	you		not
No, you

Sentence 243) BLEU: 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.5/0.2/0/0) ; 0 (0.8/0.25/0/0) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.6/0.25/0/0)

Source

��

�o��

��

�^��

�C

Ref 0

Please

exchange

this

into

U.K.

pounds.

Ref 1

Please

change

this

into

U.K.

pounds.

Ref 2

I'd

have

this

exchanged

into

U.K.

pounds,

please.

Ref 3

Please

give

U.K.

pounds

for

this.

Ref 4

Please

change

this

into

British

pounds.

Ref 5

Please

give

pounds

for

this.

Ref 6

Please

let

have

pounds

for

this.

Ref 7

Could

you

exchange

this

into

pounds,

please?

Ref 8

I'd

cash

this

into

pounds,

please.

Ref 9

want

exchange

this

into

pounds,

please.

Ref 10

I'd

this

converted

into

U.K.

pounds.

Ref 11

This

needs

exchanging

for

U.K.

pounds.

Ref 12

Would

you

mind

converting

this

into

U.K.

pounds?

Ref 13

would

change

this

into

British

pounds.

Ref 14

would

exchange

this

into

British

pounds.

Ref 15

Please

change

this

British

pounds.

Output 0

Please

change

this

into

pound.

N-grams

Please	change	this	into	pound.
Please	change	this	into
Please change		this into
Please change this
Please change this into
	change this
	change this into

Output 1

please

this

into

change

pound

N-grams

please	this	into	change	pound	.
	this	into	change
	this into

Output 2

Please

put

this

into

pounds.

N-grams

Please	put	this	into	pounds.
Please		this	into	pounds.
		this into

Output 3

Please

change

this

into

pound.

N-grams

Please	change	this	into	pound.
Please	change	this	into
Please change		this into
Please change this
Please change this into
	change this
	change this into

Output 4

Please

change

into

the

pound.

N-grams

Please	change	into	the	pound.
Please	change	into
Please change

Sentence 244) BLEU: 0 (0.8333/0.6/0/0) ; 0 (0.7143/0.5/0.2/0) ; 0 (0.8333/0.6/0/0) ; 0 (0.75/0.4286/0.1667/0) ; 0 (0.5714/0.1667/0/0)

Source

��

�ж�

��

�S

�F

�C

Ref 0

The

hot

water

doesn't

work

room.

Ref 1

The

hot

water

room

doesn't

work.

Ref 2

The

hot

water

isn't

working

room.

Ref 3

can't

get

any

hot

water

room

come

out.

Ref 4

room,

there's

hot

water

coming

out.

Ref 5

The

hot

water

room

isn't

working.

Ref 6

don't

have

any

hot

water

room.

Ref 7

There's

hot

water

room.

Ref 8

can't

get

any

hot

water

room.

Ref 9

don't

seem

getting

any

hot

water

room.

Ref 10

There's

running

hot

water

room.

Ref 11

I've

got

hot

water

room.

Ref 12

room

doesn't

have

running

hot

water.

Ref 13

There's

hot

water

room.

Ref 14

There's

not

hot

water

coming

out

the

tap

room.

Ref 15

There's

hot

water

available

room.

Output 0

room

had

hot

water.

N-grams

My	room	had	no	hot	water.
My	room		no	hot	water.
My room			no hot
				hot water.

Output 1

room

had

hot

water

N-grams

my	room	had	no	hot	water	.
my	room		no	hot	water
my room			no hot
			no hot water
				hot water

Output 2

room

had

hot

water.

N-grams

My	room	had	no	hot	water.
My	room		no	hot	water.
My room			no hot
				hot water.

Output 3

The

hot

water

room

had

no.

N-grams

The	hot	water	of	my	room	had	no.
The	hot	water	of	my	room
The hot				my room
The hot water
	hot water

Output 4

room's

hot

water

did

not

have.

N-grams

My	room's	hot	water	did	not	have.
My		hot	water		not
		hot water

Sentence 245) BLEU: 0.4273 (0.875/0.5714/0.3333/0.2) ; 0 (0.875/0/0/0) ; 0 (0.4/0/0/0) ; 0.4273 (0.875/0.5714/0.3333/0.2) ; 0 (0.625/0/0/0)

Source

�h

��

��O

��

��l

�C

Ref 0

the

table

with

the

green

light.

Ref 1

the

table

with

the

green

light

it.

Ref 2

the

table

that

has

green

light

it.

Ref 3

the

table

that

has

green

light

lit

it.

Ref 4

the

table

with

the

green

light

it.

Ref 5

the

table

holding

the

green

lamp.

Ref 6

the

table

that

has

green

lamp

it.

Ref 7

Please

proceed

the

table

with

the

green

light.

Ref 8

Would

you

the

desk

with

the

green

light?

Ref 9

the

desk

with

the

green

light,

please.

Ref 10

Head

for

the

table

with

the

green

light.

Ref 11

Make

your

way

the

table

with

the

green

light.

Ref 12

Proceed

towards

the

table

with

the

green

light.

Ref 13

the

counter

that

has

green

light.

Ref 14

Please

the

green

light.

Ref 15

Please

the

counter

which

has

green

colored

light.

Output 0

the

table

that

green

light.

N-grams

Go	to	the	table	of	that	green	light.
Go	to	the	table		that	green	light.
Go to		the table				green light.
Go to the
Go to the table
	to the
	to the table

Output 1

the

green

table

that

light

N-grams

the	go	green	table	to	that	light	.
the	go	green	table	to	that	light

Output 2

The

lights

green

table.

N-grams

The	lights	go	green	table.
		go	green

Output 3

the

table

that

green

light.

N-grams

Go	to	the	table	of	that	green	light.
Go	to	the	table		that	green	light.
Go to		the table				green light.
Go to the
Go to the table
	to the
	to the table

Output 4

Goes

that

green

color

light

the

table.

N-grams

Goes	to	that	green	color	light	the	table.
	to	that	green		light	the

Sentence 246) BLEU: 0 (0.5/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0)

Source

��

�b

��

�H

Ref 0

Which

teams

are

playing?

Ref 1

Who's

playing?

Ref 2

What

teams

are

playing?

Ref 3

Who's

playing

who?

Ref 4

Who's

playing

who?

Ref 5

Which

teams

this

game

between?

Ref 6

What

teams

are

playing

each

other?

Ref 7

Who's

playing?

Ref 8

Which

are

the

teams

that

are

competing?

Ref 9

What

teams

are

competing?

Ref 10

Whom

the

match

between?

Ref 11

Who

are

the

players

the

match?

Ref 12

Who's

playing?

Ref 13

What

are

the

teams

that

will

the

game?

Ref 14

Which

teams

will

playing

this

game?

Ref 15

Which

teams

will

this

game?

Output 0

that

team

competing?

N-grams

Is	that	team	competing?
	that		competing?

Output 1

team

competition

that

N-grams

team	competition	that	?
		that

Output 2

The

team

competition?

N-grams

The

team

competition?

Output 3

that

team

competing?

N-grams

Is	that	team	competing?
	that		competing?

Output 4

That

team

competition?

N-grams

That

team

competition?

Sentence 247) BLEU: 1 (1/1/1/1) ; 0 (0.75/0.2857/0/0) ; 1 (1/1/1/1) ; 0.6914 (1/0.8571/0.6667/0.4) ; 0 (1/0.5714/0/0)

Source

��

�A

��w

��

�C

Ref 0

I'm

glad

you

it.

Ref 1

I'm

happy

see

that

you

it.

Ref 2

I'm

pleased

hear

that

you

it.

Ref 3

I'm

delighted

that

you

it.

Ref 4

I'm

happy

that

you

it.

Ref 5

I'm

really

pleased

that

you

it.

Ref 6

I'm

very

happy

that

it's

your

liking.

Ref 7

It's

great

that

you

it.

Ref 8

pleases

that

you

it.

Ref 9

It's

great

that

you

it.

Ref 10

I'm

happy

you

it.

Ref 11

makes

happy

that

you

it.

Ref 12

glad

that

you

have

taken

liking

it.

Ref 13

happy

that

you

are

fond

it.

Ref 14

happy

that

your

taste.

Ref 15

I'm

glad

you

it.

Output 0

I'm

glad

you

it.

N-grams

I'm	glad	you	like	it.
I'm	glad	you	like	it.
I'm glad		you like
I'm glad you			like it.
I'm glad you like
	glad you
	glad you like
	glad you like it.
		you like it.

Output 1

you

very

happy

N-grams

i	you	like	it	am	very	happy	.
	you	like	it	am	very	happy
	you like				very happy

Output 2

I'm

glad

you

it.

N-grams

I'm	glad	you	like	it.
I'm	glad	you	like	it.
I'm glad		you like
I'm glad you			like it.
I'm glad you like
	glad you
	glad you like
	glad you like it.
		you like it.

Output 3

very

happy

that

you

it.

N-grams

I	am	very	happy	that	you	like	it.
I	am	very	happy	that	you	like	it.
I am		very happy		that you		like it.
		very happy that			you like
			happy that		you like it.
			happy that you
			happy that you like
				that you like
				that you like it.

Output 4

very

happy

you

it.

N-grams

I	am	very	happy	you	to	like	it.
I	am	very	happy	you	to	like	it.
I am		very happy				like it.
			happy you

Sentence 248) BLEU: 0.7506 (0.8889/0.75/0.7143/0.6667) ; 0.2907 (0.6/0.3333/0.25/0.1429) ; 0.7506 (0.8889/0.75/0.7143/0.6667) ; 0.502 (0.8889/0.5/0.4286/0.3333) ; 0.4617 (0.9091/0.6/0.3333/0.25)

Source

��

�Q

�n

�R

�@��

�B�I

�C

��

��w

��

�C

Ref 0

want

buy

some

lipstick.

I'd

rose

color.

Ref 1

would

buy

some

lipstick.

want

rose

color.

Ref 2

want

get

some

lipstick.

rose

color

would

nice.

Ref 3

want

purchase

some

lipstick.

I'd

rose

color.

Ref 4

I'd

get

some

lipstick.

I'd

rose.

Ref 5

need

buy

some

lipstick.

Rose

the

color

want.

Ref 6

have

get

some

lipstick.

I'd

get

the

rose

tint.

Ref 7

I'd

get

some

lipstick.

I'm

looking

for

rose

color.

Ref 8

I'm

looking

for

some

lipstick.

It's

rose

color

that

want.

Ref 9

Could

get

some

lipstick?

want

rose

color.

Ref 10

I'd

buy

lipstick.

Preferably

rose

colour.

Ref 11

need

lipstick.

The

rose

colour

would

best.

Ref 12

want

some

lipstick.

Rose

colour

would

nice.

Ref 13

would

purchase

lipstick.

rose

color

would

good.

Ref 14

would

buy

lipstick.

Rose

color

good.

Ref 15

wish

get

some

lipstick.

Rose

good

color.

Output 0

want

buy

some

lipstick.

pink.

N-grams

I	want	to	buy	some	lipstick.	I	like	pink.
I	want	to	buy	some	lipstick.	I	like
I want		to buy		some lipstick.
I want to			buy some		lipstick. I
I want to buy				some lipstick. I
	want to		buy some lipstick.
	want to buy
	want to buy some
		to buy some
		to buy some lipstick.
			buy some lipstick. I

Output 1

want

buy

some

lipsticks

rose

N-grams

i	want	to	buy	some	i	like	lipsticks	rose	.
	want	to	buy	some		like		rose
	want to		buy some
	want to buy
	want to buy some
		to buy
		to buy some

Output 2

want

buy

some

lipstick.

pink.

N-grams

I	want	to	buy	some	lipstick.	I	like	pink.
I	want	to	buy	some	lipstick.	I	like
I want		to buy		some lipstick.
I want to			buy some		lipstick. I
I want to buy				some lipstick. I
	want to		buy some lipstick.
	want to buy
	want to buy some
		to buy some
		to buy some lipstick.
			buy some lipstick. I

Output 3

want

buy

some

lipsticks.

rose.

N-grams

I	want	to	buy	some	lipsticks.	I	like	rose.
I	want	to	buy	some		I	like	rose.
I want		to buy
I want to			buy some
I want to buy
	want to
	want to buy
	want to buy some
		to buy some

Output 4

want

buy

some

lipsticks.

the

rose

color.

N-grams

I	want	to	buy	some	lipsticks.	I	like	the	rose	color.
I	want	to	buy	some		I	like	the	rose	color.
I want		to buy						the rose
I want to			buy some						rose color.
I want to buy
	want to
	want to buy
	want to buy some
		to buy some

Sentence 249) BLEU: 0 (0.2857/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.6/0/0/0)

Source

��

�A

�o

�O

�v�K��

��

�J��

��

�H

Ref 0

Hello,

this

the

Smith

residence?

Ref 1

Hello,

this

where

the

Smiths

live?

Ref 2

Hello,

the

Smiths

live

here?

Ref 3

Hello,

this

the

Smiths?

Ref 4

Hi,

this

the

Smith

home?

Ref 5

Hello,

speaking

with

the

Smiths?

Ref 6

Hello,

would

this

the

Smith

residence?

Ref 7

Hello,

speaking

the

Smith

residence?

Ref 8

Hello,

have

contacted

the

Smith

residence?

Ref 9

Hi,

the

Smiths

live

here?

Ref 10

Hello,

this

where

the

Smiths

reside?

Ref 11

Excuse

me,

would

this

happen

where

the

Smiths

live?

Ref 12

Hello,

this

the

Smith's?

Ref 13

Hello,

looking

for

the

Smith's.

Ref 14

Hello,

Have

contacted

the

Smith's?

Ref 15

Hello,

this

the

Smith

residence?

Output 0

Hey,

this

Smith's

home

it?

N-grams

Hey,	this	is	Smith's	home	in	it?
	this	is

Output 1

this

smith

N-grams

,	this	is	smith	's	?
	this	is

Output 2

Hey,

this

Smith's

home

it?

N-grams

Hey,	this	is	Smith's	home	in	it?
	this	is

Output 3

Hello,

this

Smith's

dwelling?

N-grams

Hello,	is	this	Smith's	dwelling?
Hello,	is	this
Hello, is
Hello, is this
	is this

Output 4

Feeds,

this

Smith's

residence?

N-grams

Feeds,	this	is	Smith's	residence?
	this	is		residence?

Sentence 250) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.25/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0)

Source

�A

��

�H

Ref 0

How's

your

meal?

Ref 1

How

you

your

meal?

Ref 2

How

has

your

meal

been?

Ref 3

How's

the

food?

Ref 4

What

you

think

the

food?

Ref 5

How

you

your

meal?

Ref 6

Are

you

enjoying

your

meal?

Ref 7

your

meal

okay?

Ref 8

everything

alright

with

your

meal?

Ref 9

your

meal

fine?

Ref 10

How

you

find

your

meal?

Ref 11

How

you

your

meal?

Ref 12

How

was

supper?

Ref 13

Was

dining

satisfactory?

Ref 14

Did

you

your

meal?

Ref 15

How's

your

meal?

Output 0

How

your

meal?

N-grams

How	to	your	meal?
How		your	meal?
		your meal?

Output 1

how

your

N-grams

how	your	is	?
	your

Output 2

How

your

meal?

N-grams

How	to	your	meal?
How		your	meal?
		your meal?

Output 3

How

your

rice?

N-grams

How	is	your	rice?
How		your

Output 4

Your

food

what

kind

of?

N-grams

Your

food

what

kind

of?

Sentence 251) BLEU: 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0)

Source

��M

�C

Ref 0

Sure.

Ref 1

OK.

Ref 2

course.

Ref 3

Sure

you

can.

Ref 4

That's

fine.

Ref 5

OK,

sure.

Ref 6

All

right.

Ref 7

Certainly.

Ref 8

course.

Ref 9

Please,

ahead.

Ref 10

problem.

Ref 11

ahead.

Ref 12

Please

help

yourself.

Ref 13

ahead.

Ref 14

guest.

Ref 15

course.

Output 0

Certainly.

N-grams

Certainly.

Output 1

certainly

N-grams

certainly

Output 2

當然.

N-grams

當然.

Output 3

Certainly.

N-grams

Certainly.

Output 4

Certainly.

N-grams

Certainly.

Sentence 252) BLEU: 0 (0.6/0.5/0.3333/0) ; 0 (0.2/0/0/0) ; 0 (0.75/0/0/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.3333/0/0/0)

Source

�n��

�A

�ҤH

�C

��

�b

�o��

ñ�r

�C

Ref 0

All

right,

ma'am.

Please

sign

here.

Ref 1

Alright.

Please

sign

here.

Ref 2

Alright.

Please

put

your

signature

here.

Ref 3

OK.

Please

sign

your

name

here.

Ref 4

OK,

see.

Please

sign

your

name

here.

Ref 5

Sure,

understand.

Please

put

your

signature

here.

Ref 6

Yes,

see.

Your

signature

here,

please.

Ref 7

Okay.

Sign

right

here,

please.

Ref 8

see.

Would

you

sign

here,

please?

Ref 9

understand.

Your

signature

here,

please.

Ref 10

Okay.

Would

you

mind

signing

here.

Ref 11

Right.

I'd

you

sign

here.

Ref 12

Yes.

Your

signature

needs

here.

Ref 13

understand.

Please

sign

here.

Ref 14

get

it.

Please

write

your

signature

here.

Ref 15

Understood.

Please

sign

this

area.

Output 0

Okay,

madam.

Please

sign

here.

N-grams

Okay,	madam.	Please	sign	here.
		Please	sign	here.
		Please sign
		Please sign here.
			sign here.

Output 1

signature

here

please

N-grams

,	signature	here	please	.
	signature

Output 2

OK,

ma'am.

Signature

here.

N-grams

OK,	ma'am.	Signature	here.
OK,	ma'am.		here.

Output 3

Okay,

madam.

Please

sign

here.

N-grams

Okay,	madam.	Please	sign	here.
		Please	sign	here.
		Please sign
		Please sign here.
			sign here.

Output 4

Good,

madame.

Please

here

signature.

N-grams

Good,	madame.	Please	in	here	signature.
		Please	in

Sentence 253) BLEU: 0 (0.4545/0.1/0/0) ; 0 (0.4444/0/0/0) ; 0 (0.5455/0/0/0) ; 0 (0.4545/0.1/0/0) ; 0 (0.3333/0/0/0)

Source

�藍�_

�A

��N

�M

�A

��

�@

�i

��l

��

�H

Ref 0

Sorry,

would

you

mind

sharing

your

table?

Ref 1

Excuse

me,

but

would

you

mind

sharing

your

table?

Ref 2

Excuse

me,

but

would

you

with

sharing

your

table?

Ref 3

Excuse

me,

can

ask

you

your

table,

please?

Ref 4

Excuse

me,

but

would

you

kind

the

table?

Ref 5

I'm

sorry,

but

may

ask

you

would

your

table?

Ref 6

Pardon

me,

but

would

your

table?

Ref 7

apologize

but

could

you

your

table?

Ref 8

Excuse

me,

but

would

you

mind

someone

sat

here?

Ref 9

Pardon

me,

but

would

you

consider

sharing

your

table?

Ref 10

Excuse

me,

but

could

you

please

your

table?

Ref 11

I'm

sorry,

but

okay

your

table?

Ref 12

Sorry

bother

you,

but

would

alright

your

table?

Ref 13

Excuse

me,

may

your

table?

Ref 14

Excuse

me,

this

seat

taken?

Ref 15

Excuse

me,

may

sit

here

also?

Output 0

Execuse

me,

you

mind

use

table

with

you?

N-grams

Execuse	me,	do	you	mind	to	use	a	table	with	you?
	me,		you	mind	to				with
			you mind

Output 1

mind

you

use

table

with

you

N-grams

,	mind	you	use	a	table	with	you	?
	mind	you				with

Output 2

beg

your

pardon,

your

mind

and

you

use

table?

N-grams

I	beg	your	pardon,	your	mind	and	you	use	a	table?
I		your			mind		you			table?

Output 3

Execuse

me,

you

mind

use

table

with

you?

N-grams

Execuse	me,	do	you	mind	to	use	a	table	with	you?
	me,		you	mind	to				with
			you mind

Output 4

Sorry,

you

minded

that

uses

table

with

you?

N-grams

Sorry,	you	minded	that	uses	a	table	with	you?
Sorry,	you						with

Sentence 254) BLEU: 0 (0.8/0.25/0/0) ; 0 (0.2/0/0/0) ; 0 (0.8/0.25/0/0) ; 0 (0.8/0.25/0/0) ; 0 (0.6/0.25/0/0)

Source

��

�n

�Y

��

�C

Ref 0

I'll

have

the

fish.

Ref 1

Fish,

please.

Ref 2

I'd

the

fish.

Ref 3

want

the

fish.

Ref 4

Fish,

please.

Ref 5

Let's

make

the

fish.

Ref 6

I'll

with

the

fish.

Ref 7

I'll

make

fish.

Ref 8

I'll

take

fish.

Ref 9

I'd

have

fish.

Ref 10

I'd

the

fish.

Ref 11

The

fish,

please.

Ref 12

Fish

for

me.

Ref 13

will

take

the

fish.

Ref 14

Fish

please.

Ref 15

I'll

for

the

fish.

Output 0

want

eat

fish.

N-grams

I	want	to	eat	fish.
I	want	to		fish.
I want

Output 1

fish

eat

N-grams

i	to	fish	eat	.
	to

Output 2

would

fish.

N-grams

I	would	like	to	fish.
I		like	to	fish.
		like to

Output 3

want

eat

fish.

N-grams

I	want	to	eat	fish.
I	want	to		fish.
I want

Output 4

must

eat

the

fish.

N-grams

I	must	eat	the	fish.
I			the	fish.
			the fish.

Sentence 255) BLEU: 0.4133 (1/0.7/0.3333/0.125) ; 0 (0.6/0.2222/0/0) ; 0.4133 (1/0.7/0.3333/0.125) ; 0 (0.8125/0.4/0.1429/0) ; 0 (0.7778/0.25/0/0)

Source

��

��w

��

�C

�ڭ�

�{�b

�b

��

�C

Ref 0

prefer

American

car.

are

America

now.

Ref 1

prefer

American

cars.

This

America,

after

all.

Ref 2

would

prefer

American

car.

We're

America

now,

you

know.

Ref 3

would

American

car.

America,

after

all.

Ref 4

I'd

rather

have

American

car.

Since

are

America.

Ref 5

I'd

interested

American

car.

After

all,

this

the

US.

Ref 6

American

car

would

better.

This

the

States,

after

all.

Ref 7

I'd

rather

have

American

car.

This

America,

after

all.

Ref 8

preference

for

American

car.

After

all,

this

the

United

States.

Ref 9

think

American

car

would

better.

mean,

this

the

United

States.

Ref 10

Let's

get

American

car.

This

America

after

all.

Ref 11

I'll

choose

American

car,

since

this

America.

Ref 12

American

car

best

now

we're

the

States.

Ref 13

would

American

car.

Because

are

America

now.

Ref 14

American

car

better.

After

all,

are

America

now.

Ref 15

American

car

would

better.

Since

are

America

now.

Output 0

prefer

American

cars.

are

now

the

United

States.

N-grams

I	prefer	American	cars.	We	are	now	in	the	United	States.
I	prefer	American	cars.	We	are	now	in	the	United	States.
I prefer		American cars.		We are			in the		United States.
I prefer American								the United
I prefer American cars.								the United States.
	prefer American
	prefer American cars.

Output 1

are

now

the

united

states

N-grams

i	we	are	now	in	the	united	states	like	.
	we	are	now	in	the			like
	we are			in the

Output 2

prefer

American

cars.

are

now

the

United

States.

N-grams

I	prefer	American	cars.	We	are	now	in	the	United	States.
I	prefer	American	cars.	We	are	now	in	the	United	States.
I prefer		American cars.		We are			in the		United States.
I prefer American								the United
I prefer American cars.								the United States.
	prefer American
	prefer American cars.

Output 3

even

the

car

the

United

States.

are

the

United

States

now.

N-grams

even

the

car

the

United

States.

are

the

United

States

now.

the

car

the United

States.

are

now.

the United States.

We are

in the

United

We are in

United States.

are in

Output 4

US's

vehicle.

now

the

US.

N-grams

I	like	US's	vehicle.	We	now	in	the	US.
I	like			We	now	in	the	US.
						in the
							the US.

Sentence 256) BLEU: 0 (0.1429/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.6/0/0/0) ; 0 (0.4/0/0/0)

Source

��

�

��

�n

��

�H

Ref 0

Will

get

better

soon?

Ref 1

Will

better

soon?

Ref 2

Will

get

over

this

soon?

Ref 3

Will

get

well

soon?

Ref 4

Will

recover

quickly?

Ref 5

going

well

soon?

Ref 6

Will

recovery

quick?

Ref 7

you

think

I'll

heal

soon?

Ref 8

Will

getting

better

soon?

Ref 9

Will

heal

quickly?

Ref 10

Will

take

long

get

better?

Ref 11

Will

make

quick

recovery?

Ref 12

Will

get

well

quickly?

Ref 13

Will

heal

quickly?

Ref 14

Will

heal

fast?

Ref 15

Will

recover

soon?

Output 0

could

very

quickly

become

all

right?

N-grams

I	could	very	quickly	become	all	right?
I

Output 1

very

N-grams

very

Output 2

could

very

quickly

become

all

right?

N-grams

I	could	very	quickly	become	all	right?
I

Output 3

soon

grow

better?

N-grams

Do	I	soon	grow	better?
Do	I			better?

Output 4

very

quick

will

improve?

N-grams

I	very	quick	will	improve?
I		quick

Sentence 257) BLEU: 0.6804 (0.8571/0.8333/0.6/0.5) ; 0 (0.5714/0.1667/0/0) ; 0.6804 (0.8571/0.8333/0.6/0.5) ; 0 (0.8333/0.6/0.25/0) ; 0 (0.7778/0.375/0.1429/0)

Source

��

�H�Υd

�I��

��

�H

Ref 0

Can

pay

with

credit

card?

Ref 1

Can

pay

credit

card?

Ref 2

Can

use

credit

card

pay?

Ref 3

alright

pay

credit

card?

Ref 4

May

pay

credit

card?

Ref 5

Can

make

the

payment

with

credit

card?

Ref 6

Can

put

credit

card?

Ref 7

possible

pay

credit

card?

Ref 8

you

take

payment

credit

card?

Ref 9

Will

able

pay

credit

card?

Ref 10

wonder

could

pay

credit

card.

Ref 11

you

mind

use

credit

card

pay?

Ref 12

you

credit

cards?

Ref 13

May

use

credit

card?

Ref 14

you

payment

credit

card?

Ref 15

possible

pay

credit

card?

Output 0

Can

pay

credit

card

it?

N-grams

Can	I	pay	by	credit	card	it?
Can	I	pay	by	credit	card
Can I		pay by		credit card
Can I pay			by credit
Can I pay by
	I pay
	I pay by
	I pay by credit
		pay by credit

Output 1

can

pay

credit

card

use

N-grams

can	i	pay	credit	card	use	?
		pay	credit	card	use
			credit card

Output 2

Can

pay

credit

card

it?

N-grams

Can	I	pay	by	credit	card	it?
Can	I	pay	by	credit	card
Can I		pay by		credit card
Can I pay			by credit
Can I pay by
	I pay
	I pay by
	I pay by credit
		pay by credit

Output 3

Can

use

credit

card

payment?

N-grams

Can	I	use	credit	card	payment?
Can	I	use	credit	card
Can I			credit card
Can I use
	I use

Output 4

can

use

the

credit

card

pay

money?

N-grams

I	can	use	the	credit	card	to	pay	money?
I		use	the	credit	card	to	pay
				credit card		to pay
				credit card to
					card to

Sentence 258) BLEU: 0 (1/1/0/0) ; 0 (0.3333/0/0/0) ; 0 (1/1/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0)

Source

�ߤW�n

�C

Ref 0

Good

evening.

Ref 1

Evening.

Ref 2

Hello.

Ref 3

Hello.

Ref 4

Evening.

Ref 5

pleasant

evening

you.

Ref 6

Hello.

Ref 7

Hi.

Ref 8

Hello

there.

Ref 9

Hello.

Ref 10

Evening.

Ref 11

Hi.

Ref 12

Good

evening

you.

Ref 13

Hello.

Ref 14

Evening.

Ref 15

Good

evening.

Output 0

Good

evening.

N-grams

Good	evening.
Good	evening.
Good evening.

Output 1

good

evening

N-grams

good	evening	.
	evening

Output 2

Good

evening.

N-grams

Good	evening.
Good	evening.
Good evening.

Output 3

Good

the

evening.

N-grams

Good	in	the	evening.
Good			evening.

Output 4

Good

night.

N-grams

Good	night.
Good

Sentence 259) BLEU: 0.3689 (0.7778/0.5/0.2857/0.1667) ; 0 (0.5/0/0/0) ; 0.3689 (0.7778/0.5/0.2857/0.1667) ; 0 (0.7/0.2222/0/0) ; 0.3156 (0.5556/0.375/0.2857/0.1667)

Source

�A

��

�Ӭ�

�o��

��

�H

Ref 0

Could

you

look

after

this

luggage

for

please?

Ref 1

Can

you

look

after

this

luggage

for

me,

please?

Ref 2

Please

look

after

this

luggage

for

me.

Ref 3

Please

watch

over

luggage

for

me.

Ref 4

Could

you

take

care

this

luggage

please?

Ref 5

Would

you

able

keep

this

bag

for

please?

Ref 6

Could

you

please

keep

eye

this

luggage?

Ref 7

I'd

check

these

bags.

Ref 8

Would

possible

for

you

watch

these

bags,

please?

Ref 9

Could

leave

these

bags

with

you?

Ref 10

I'd

have

luggage

stored.

Ref 11

Would

you

mind

keeping

hold

this

luggage

for

me?

Ref 12

I'd

someone

look

after

this

luggage

for

me.

Ref 13

Could

you

take

care

this

luggage

for

me,

please?

Ref 14

Could

ask

you

take

this

luggage

for

me,

please?

Ref 15

May

check

luggage

with

you,

please?

Output 0

Would

you

help

take

care

this

baggage?

N-grams

Would	you	help	me	take	care	of	this	baggage?
Would	you		me	take	care	of	this
Would you				take care		of this
				take care of
				take care of this
					care of
					care of this

Output 1

you

help

this

baggage

can

N-grams

you	help	me	this	baggage	can	to	?
you		me	this			to

Output 2

Would

you

help

take

care

this

baggage?

N-grams

Would	you	help	me	take	care	of	this	baggage?
Would	you		me	take	care	of	this
Would you				take care		of this
				take care of
				take care of this
					care of
					care of this

Output 3

Can

you

shine

see

this

baggage

for

me?

N-grams

Can	you	shine	on	to	see	this	baggage	for	me?
Can	you		on	to		this		for	me?
Can you								for me?

Output 4

You

can

help

look

after

this

baggage?

N-grams

You	can	help	me	to	look	after	this	baggage?
			me	to	look	after	this
				to look		after this
				to look after
				to look after this
					look after
					look after this

Sentence 260) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.5/0/0/0)

Source

��

�~�O�D

��

�H

Ref 0

May

take

shower?

Ref 1

Can

take

shower?

Ref 2

alright

take

shower?

Ref 3

you

mind

take

shower?

Ref 4

Would

you

mind

took

shower?

Ref 5

Would

for

take

shower?

Ref 6

all

right

take

shower?

Ref 7

Could

take

shower?

Ref 8

Would

alright

for

have

shower?

Ref 9

okay

take

shower?

Ref 10

you

mind

have

shower?

Ref 11

Could

shower?

Ref 12

Would

okay

for

take

shower?

Ref 13

alright

take

shower?

Ref 14

Could

take

shower?

Ref 15

possible

take

shower?

Output 0

Can

wash

shower?

N-grams

Can	I	wash	shower?
Can	I		shower?
Can I

Output 1

can

shower

wash

N-grams

can

shower

wash

Output 2

can

shower

it?

N-grams

I	can	shower	it?
I

Output 3

Can

wash

shower?

N-grams

Can	I	wash	shower?
Can	I		shower?
Can I

Output 4

can

wash

shower?

N-grams

I	can	wash	shower?
I			shower?

Sentence 261) BLEU: 0 (0.6667/0.4/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.6667/0.4/0/0) ; 0 (0.5/0.1429/0/0) ; 0 (0.6/0.25/0/0)

Source

�ڭ�

��b

�M

�ϢТѤj��

��

�C

Ref 0

are

playing

against

ABC

University.

Ref 1

ABC

University

who

are

playing

against.

Ref 2

between

and

ABC

University.

Ref 3

ABC

University

our

rival.

Ref 4

The

game

with

ABC

University.

Ref 5

The

match

against

ABC

University.

Ref 6

It's

against

ABC

University.

Ref 7

We're

match

with

ABC

University.

Ref 8

The

opponent

ABC

University.

Ref 9

The

game

with

ABC

University.

Ref 10

are

competing

against

ABC

University.

Ref 11

are

playing

match

with

ABC

University.

Ref 12

are

competition

with

ABC

University.

Ref 13

The

other

team

ABC

University.

Ref 14

versus

ABC

University.

Ref 15

Our

team

playing

versus

ABC

University.

Output 0

are

and

ABC

college

game.

N-grams

We	are	and	ABC	college	game.
We	are	and	ABC
We are		and ABC

Output 1

are

abc

with

university

N-grams

we	are	abc	with	university	.
we	are		with
we are

Output 2

are

and

ABC

college

game.

N-grams

We	are	and	ABC	college	game.
We	are	and	ABC
We are		and ABC

Output 3

are

just

competing

with

the

�ϢТ�

university.

N-grams

We	are	just	competing	with	the	�ϢТ�	university.
We	are		competing	with
We are

Output 4

with

ABC

university

competition.

N-grams

We	with	ABC	university	competition.
We	with	ABC
	with ABC

Sentence 262) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.6/0.5/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.75/0.6667/0.5/0)

Source

��

�w��

�C

Ref 0

Please

cancel

reservation.

Ref 1

want

cancel

reservation.

Ref 2

Please

cancel

the

reservation

that

made.

Ref 3

want

reservation

cancelled.

Ref 4

Cancel

reservation

you

would,

please.

Ref 5

Could

you

please

cancel

the

reservation

had?

Ref 6

have

reservation

that

need

ask

you

cancel.

Ref 7

I'd

you

cancel

reservations.

Ref 8

want

reservations

canceled,

please.

Ref 9

Could

you

cancel

reservations,

please?

Ref 10

I'd

cancel

reservation.

Ref 11

reservation

needs

cancelling.

Ref 12

Would

you

mind

cancelling

reservation?

Ref 13

would

cancel

reservation.

Ref 14

Please

delete

reservation.

Ref 15

Please

erase

reservation.

Output 0

Please

cancel

appointment.

N-grams

Please	cancel	my	appointment.
Please	cancel	my
Please cancel
Please cancel my
	cancel my

Output 1

please

cancel

appointment

N-grams

please	cancel	my	appointment	.
please	cancel	my
please cancel
	cancel my

Output 2

Please

cancel

appointment.

N-grams

Please	cancel	my	appointment.
Please	cancel	my
Please cancel
Please cancel my
	cancel my

Output 3

Please

cancel

reserve.

N-grams

Please	cancel	my	to	reserve.
Please	cancel	my	to
Please cancel
Please cancel my
	cancel my

Output 4

Please

cancel

appointment.

N-grams

Please	cancel	my	appointment.
Please	cancel	my
Please cancel
Please cancel my
	cancel my

Sentence 263) BLEU: 0 (0.5/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�A

��

�o

��

�H

Ref 0

How

are

you

doing?

Ref 1

How

are

you

feeling?

Ref 2

How

are

things?

Ref 3

How

are

you?

Ref 4

How

are

you

feeling?

Ref 5

How's

everything?

Ref 6

How's

going?

Ref 7

Are

you

doing

well?

Ref 8

everything

okay?

Ref 9

How's

going

for

you?

Ref 10

How

are

things

going?

Ref 11

How

everything?

Ref 12

How

are

you

getting

on?

Ref 13

How

are

thing

going?

Ref 14

How

are

things

for

you?

Ref 15

Are

you

doing

well?

Output 0

How

you

make?

N-grams

How	do	you	make?
How		you

Output 1

how

you

N-grams

how	do	you	?
		you

Output 2

How

you

make?

N-grams

How	do	you	make?
How		you

Output 3

You

how?

N-grams

You

how?

Output 4

You

what

kind

of?

N-grams

You

what

kind

of?

Sentence 264) BLEU: 0 (0.75/0.5714/0.3333/0) ; 0 (0.5/0.2222/0/0) ; 0 (0.75/0.5714/0.3333/0) ; 0.4111 (0.75/0.5714/0.3333/0.2) ; 0 (0.5/0.2222/0/0)

Source

��

�Q�n

��

�餸

��

�C

Ref 0

I'd

exchange

this

yen

into

dollars.

Ref 1

want

change

this

yen

into

dollars.

Ref 2

want

exchange

this

yen

for

dollars.

Ref 3

want

dollars

for

this

yen.

Ref 4

want

trade

yen

for

dollars.

Ref 5

I'd

change

yen

for

dollars.

Ref 6

I'm

hoping

exchange

some

yen

for

dollars.

Ref 7

want

cash

this

yen

into

dollars.

Ref 8

Could

exchange

this

yen

into

dollars,

please?

Ref 9

Please

cash

this

yen

into

dollars.

Ref 10

Please

convert

this

yen

into

dollars.

Ref 11

Would

you

mind

having

this

yen

changed

into

dollars?

Ref 12

This

yen

needs

exchanging

for

dollars.

Ref 13

would

convert

these

yen

into

dollars.

Ref 14

would

get

dollars

for

these

yen.

Ref 15

May

exchange

these

yen

into

dollars?

Output 0

want

bring

the

yen

into

dollars.

N-grams

I	want	to	bring	the	yen	into	dollars.
I	want	to			yen	into	dollars.
I want					yen into
I want to					yen into dollars.
	want to					into dollars.

Output 1

want

the

yen

into

change

dollar

N-grams

i	want	to	the	yen	into	change	us	dollar	.
	want	to		yen	into	change
	want to			yen into

Output 2

want

bring

the

yen

into

dollars.

N-grams

I	want	to	bring	the	yen	into	dollars.
I	want	to			yen	into	dollars.
I want					yen into
I want to					yen into dollars.
	want to					into dollars.

Output 3

want

change

yen

into

dollar.

N-grams

I	want	to	change	yen	into	US	dollar.
I	want	to	change	yen	into
I want		to change		yen into
I want to
I want to change
	want to
	want to change

Output 4

want

the

Japanese

Yen

change

into

dollar.

N-grams

I	want	the	Japanese	Yen	to	change	into	US	dollar.
I	want				to	change	into
I want					to change

Sentence 265) BLEU: 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.4286/0.3333/0.2/0) ; 0 (0.7143/0.5/0.2/0) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.3333/0/0/0)

Source

��

�O

��

�@

��

�H

Ref 0

Which

the

latest

color?

Ref 1

What

color

fashion?

Ref 2

What

the

hot

color

now?

Ref 3

What

color

now?

Ref 4

What

are

the

new

colors?

Ref 5

Which

colors

have

just

come

out?

Ref 6

What

are

the

most

recent

colors?

Ref 7

What's

the

newest

color?

Ref 8

What's

the

current

color?

Ref 9

What

are

some

new

colors?

Ref 10

What

color's

fashion

the

moment?

Ref 11

What's

the

newest

color?

Ref 12

What

color

has

just

come

out?

Ref 13

Which

the

recent

color?

Ref 14

Which

the

new

color?

Ref 15

Which

color

new?

Output 0

Which

the

recent

style?

N-grams

Which	is	the	recent	style?
Which	is	the	recent
Which is		the recent
Which is the
Which is the recent
	is the
	is the recent

Output 1

which

style

the

recent

one

N-grams

which	style	is	the	recent	one	?
		is	the	recent
		is the
		is the recent
			the recent

Output 2

Which

style

the

most

recent

one?

N-grams

Which	style	is	the	most	recent	one?
Which		is	the	most	recent
		is the		most recent
			the most
			the most recent

Output 3

Which

the

recent

style

N-grams

Which	is	the	recent	style	?
Which	is	the	recent
Which is		the recent
Which is the
Which is the recent
	is the
	is the recent

Output 4

Which

one

was

the

recently

style?

N-grams

Which	one	was	the	recently	style?
Which			the

Sentence 266) BLEU: 0.5 (0.875/0.7143/0.5/0.2) ; 0 (0.625/0/0/0) ; 0.5 (0.875/0.7143/0.5/0.2) ; 0.5411 (0.8571/0.6667/0.6/0.25) ; 0 (0.6667/0.4/0.25/0)

Source

��

�Q

��

�@��

�Ȧ�

�䲼

�I�{

�C

Ref 0

I'd

cash

some

traveler's

checks.

Ref 1

want

cash

traveler's

checks.

Ref 2

want

cash

traveler's

checks.

Ref 3

want

change

traveler's

checks

into

cash.

Ref 4

I'd

get

some

cash

for

traveler's

checks,

please.

Ref 5

Could

you

cash

some

traveler's

checks,

please?

Ref 6

I'd

have

cash

for

some

traveler's

checks,

please.

Ref 7

Could

you

cash

some

traveler's

checks,

please?

Ref 8

Please

cash

these

traveler's

checks.

Ref 9

want

some

traveler's

checks

cashed.

Ref 10

Please

convert

these

traveler's

checks

into

cash.

Ref 11

These

traveler's

checks

need

converting

cash.

Ref 12

Would

you

mind

having

these

traveler's

checks

converted

dollars.

Ref 13

would

convert

traveler's

checks

into

cash.

Ref 14

would

change

some

traveler's

checks

into

cash.

Ref 15

would

cash

some

traveler's

checks.

Output 0

would

honor

some

traveler's

checks.

N-grams

I	would	like	to	honor	some	traveler's	checks.
I	would	like	to		some	traveler's	checks.
I would		like to			some traveler's
I would like					some traveler's checks.
I would like to						traveler's checks.
	would like
	would like to

Output 1

some

checks

want

cash

N-grams

i	to	some	's	checks	want	cash	.
	to	some		checks	want	cash

Output 2

would

honor

some

traveler's

checks.

N-grams

I	would	like	to	honor	some	traveler's	checks.
I	would	like	to		some	traveler's	checks.
I would		like to			some traveler's
I would like					some traveler's checks.
I would like to						traveler's checks.
	would like
	would like to

Output 3

want

cash

some

trip

checks.

N-grams

I	want	to	cash	some	trip	checks.
I	want	to	cash	some		checks.
I want		to cash
I want to			cash some
I want to cash
	want to
	want to cash
		to cash some

Output 4

want

some

traller's

check

cash.

N-grams

I	want	some	traller's	check	cash.
I	want	some			cash.
I want
I want some
	want some

Sentence 267) BLEU: 0 (0.5/0.2/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.6667/0.6/0.25/0) ; 0 (0.4/0.25/0/0)

Source

�A

��

�O�s

��

�Q��

��~

��

�H

Ref 0

Could

you

keep

valuables?

Ref 1

Could

you

hold

valuables

for

me?

Ref 2

Could

you

watch

over

valuables

for

me?

Ref 3

Please

watch

over

valuables

for

me.

Ref 4

Could

you

take

care

valuables,

please?

Ref 5

Could

you

watch

valuables

for

me,

please?

Ref 6

Would

you

look

after

valuables,

please?

Ref 7

Would

possible

for

you

keep

valuables?

Ref 8

May

leave

valuables

with

you?

Ref 9

Would

you

hold

onto

valuable

for

me?

Ref 10

Would

you

mind

hanging

valuables

for

me?

Ref 11

I'd

you

take

care

valuables.

Ref 12

Please

look

after

valuables.

Ref 13

May

store

valuables

with

you?

Ref 14

you

store

valuables

here?

Ref 15

May

ask

you

take

care

valuables?

Output 0

Can

you

save

valuables

it?

N-grams

Can	you	save	my	valuables	it?
	you		my	valuables
			my valuables

Output 1

can

you

valuables

N-grams

can	you	my	valuables	?
	you	my	valuables
		my valuables

Output 2

Can

you

save

valuables

it?

N-grams

Can	you	save	my	valuables	it?
	you		my	valuables
			my valuables

Output 3

Can

you

keep

valuable

article?

N-grams

Can	you	keep	my	valuable	article?
	you	keep	my	valuable
	you keep		my valuable
	you keep my
		keep my

Output 4

You

can

preserve

valuables?

N-grams

You	can	preserve	my	valuables?
			my	valuables?
			my valuables?

Sentence 268) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.4/0.25/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.75/0.6667/0.5/0)

Source

��

�T

��

�]

�C

Ref 0

have

three

bags.

Ref 1

have

three

pieces

luggage.

Ref 2

I've

got

three

pieces

baggage.

Ref 3

have

three

bags.

Ref 4

Three

pieces

luggage.

Ref 5

It'll

three

bags.

Ref 6

It's

three

bags.

Ref 7

There

are

three

bags.

Ref 8

I've

got

three

bags.

Ref 9

Three

bags.

Ref 10

I've

three

items

luggage.

Ref 11

luggage

consists

three

bags.

Ref 12

I'm

carrying

three

bags

with

me.

Ref 13

have

three

pieces

luggage.

Ref 14

luggage

consists

three

pieces.

Ref 15

There

are

three

suitcases.

Output 0

have

three

packs.

N-grams

I	have	three	packs.
I	have	three
I have
I have three
	have three

Output 1

have

three

packages

N-grams

i	have	three	packages	.
	have	three
	have three

Output 2

have

three

packages.

N-grams

I	have	three	packages.
I	have	three
I have
I have three
	have three

Output 3

have

three

packs.

N-grams

I	have	three	packs.
I	have	three
I have
I have three
	have three

Output 4

have

three

packages.

N-grams

I	have	three	packages.
I	have	three
I have
I have three
	have three

Sentence 269) BLEU: 0.5969 (0.8889/0.75/0.5714/0.3333) ; 0.3656 (0.625/0.4286/0.3333/0.2) ; 0.5 (0.875/0.7143/0.5/0.2) ; 0.4336 (0.5833/0.4545/0.4/0.3333) ; 0.5969 (0.8889/0.75/0.5714/0.3333)

Source

��

�Q

�n

�e

�o��

�S��

�M��

��

�饻

�C

Ref 0

would

send

this

special

delivery

Japan.

Ref 1

want

send

this

special

delivery

Japan.

Ref 2

Send

this

special

delivery

Japan.

Ref 3

want

this

sent

Japan

special

delivery.

Ref 4

need

send

this

Japan

express

mail.

Ref 5

want

this

Japan

express

mail.

Ref 6

I'd

have

this

sent

Japan

express

mail.

Ref 7

Could

send

this

special

delivery

Japan?

Ref 8

Please

send

this

express

Japan.

Ref 9

want

send

express

mail

Japan.

Ref 10

Could

have

this

sent

express

mail

Japan?

Ref 11

Please

send

this

express

Japan.

Ref 12

Would

you

mind

having

this

sent

Japan

express

delivery?

Ref 13

would

send

this

express

Japan.

Ref 14

would

express

post

this

Japan.

Ref 15

would

mail

this

express

service

Japan.

Output 0

want

deliver

this

special

delivery

Japan.

N-grams

I	want	to	deliver	this	special	delivery	to	Japan.
I	want	to		this	special	delivery	to	Japan.
I want				this special		delivery to
I want to				this special delivery			to Japan.
	want to			this special delivery to
					special delivery
					special delivery to
					special delivery to Japan.
						delivery to Japan.

Output 1

send

this

japan

want

N-grams

i	to	send	this	to	japan	want	.
	to	send	this	to		want
	to send		this to
	to send this
	to send this to
		send this
		send this to

Output 2

I'd

send

this

Speedpost

Japan.

N-grams

I'd	like	to	send	this	Speedpost	to	Japan.
I'd	like	to	send	this		to	Japan.
I'd like		to send				to Japan.
I'd like to			send this
	like to
	like to send
	like to send this
		to send this

Output 3

want

send

this

fast

and

particularly

pass

Japan

especially.

N-grams

I	want	to	send	this	to	fast	and	particularly	pass	Japan	especially.
I	want	to	send	this	to					Japan
I want		to send		this to
I want to			send this
I want to send
	want to		send this to
	want to send
	want to send this
		to send this
		to send this to

Output 4

want

deliver

this

special

delivery

Japan.

N-grams

I	want	to	deliver	this	special	delivery	to	Japan.
I	want	to		this	special	delivery	to	Japan.
I want				this special		delivery to
I want to				this special delivery			to Japan.
	want to			this special delivery to
					special delivery
					special delivery to
					special delivery to Japan.
						delivery to Japan.

Sentence 270) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�C

Ref 0

That's

marvelous.

Ref 1

That's

wonderful.

Ref 2

Great.

Ref 3

That's

excellent.

Ref 4

That's

wonderful.

Ref 5

That's

fabulous.

Ref 6

That's

fantastic.

Ref 7

Fantastic.

Ref 8

How	wonderful.

Ref 9

That's

fabulous.

Ref 10

Wonderful.

Ref 11

How

lovely.

Ref 12

Fantastic.

Ref 13

Wonderful.

Ref 14

Great.

Ref 15

Spectacular.

Output 0

very

delicious.

N-grams

very

delicious.

Output 1

very

delicious

that

N-grams

very

delicious

that

Output 2

very

delicious.

N-grams

very

delicious.

Output 3

That

very

delicious.

N-grams

That

very

delicious.

Output 4

That

very

delicacy.

N-grams

That

very

delicacy.

Sentence 271) BLEU: 1 (1/1/1/1) ; 0 (0.5/0.2/0/0) ; 1 (1/1/1/1) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.8/0.5/0.3333/0)

Source

��

��a

�C

Ref 0

Brandy,

please.

Ref 1

Please

give

brandy.

Ref 2

I'll

have

brandy.

Ref 3

brandy,

please.

Ref 4

I'd

some

brandy,

please.

Ref 5

Please

bring

brandy.

Ref 6

I'll

have

brandy,

please.

Ref 7

May

have

some

brandy,

please?

Ref 8

Could

get

some

brandy,

please?

Ref 9

Please

give

some

brandy.

Ref 10

I'll

have

Brandy.

Ref 11

I'd

Brandy.

Ref 12

Would

you

mind

getting

Brandy?

Ref 13

Please

give

brandy.

Ref 14

would

brandy.

Ref 15

glass

brandy

please.

Output 0

Please

give

brandy.

N-grams

Please	give	me	a	brandy.
Please	give	me	a	brandy.
Please give		me a
Please give me			a brandy.
Please give me a
	give me
	give me a
	give me a brandy.
		me a brandy.

Output 1

please

give

brandy

the

N-grams

please	give	me	brandy	the	.
	give	me	brandy
	give me

Output 2

Please

give

brandy.

N-grams

Please	give	me	a	brandy.
Please	give	me	a	brandy.
Please give		me a
Please give me			a brandy.
Please give me a
	give me
	give me a
	give me a brandy.
		me a brandy.

Output 3

Please

give

the

brandy.

N-grams

Please	give	me	the	brandy.
Please	give	me		brandy.
Please give
Please give me
	give me

Output 4

Please

give

the

brandy.

N-grams

Please	give	me	the	brandy.
Please	give	me		brandy.
Please give
Please give me
	give me

Sentence 272) BLEU: 0 (0.7/0.1111/0/0) ; 0 (0.5/0.1111/0/0) ; 0 (0.5556/0.25/0.1429/0) ; 0 (0.6/0.1111/0/0) ; 0 (0.7/0.1111/0/0)

Source

��

�Q

�n

��

�A

��

�T

��

�ɶ�

�C

Ref 0

would

two

three

minutes

your

time,

please.

Ref 1

Can

have

two

three

minutes

your

time,

please?

Ref 2

Could

you

spare

two

three

minutes

your

time

for

me?

Ref 3

Could

take

two

three

minutes

your

time?

Ref 4

Could

speak

with

you

for

two

three

minutes?

Ref 5

May

have

two

three

minutes

your

time?

Ref 6

Could

you

spare

two

three

minutes

your

time?

Ref 7

Would

you

give

two

three

minutes

your

time?

Ref 8

Can

have

just

two

three

minutes?

Ref 9

Please

give

just

two

three

minutes

your

time.

Ref 10

just

need

two

three

minutes

your

time.

Ref 11

Would

you

mind

granting

few

minutes

your

time?

Ref 12

This

will

only

take

few

minutes.

Ref 13

Would

you

mind

giving

two

three

minutes

your

time.

Ref 14

Please

listen

for

about

two

three

minutes.

Ref 15

Could

you

give

two

three

minutes

your

time?

Output 0

want

take

you

two

three

minutes

time.

N-grams

I	want	to	take	you	two	to	three	minutes	time.
I			take	you	two		three	minutes	time.
							three minutes

Output 1

want

time

for

2-3

minutes

take

you

N-grams

i	want	to	time	for	2-3	minutes	take	you	.
			time	for		minutes	take	you
			time for

Output 2

want

occupy

your

time

for

2-3

minutes.

N-grams

I	want	to	occupy	your	time	for	2-3	minutes.
I				your	time	for		minutes.
				your time
				your time for
					time for

Output 3

want

take

you

time

for

2-3

minutes.

N-grams

I	want	to	take	up	you	time	for	2-3	minutes.
I			take		you	time	for		minutes.
						time for

Output 4

want

take

you

two

three

minutes

time.

N-grams

I	want	to	take	you	two	to	three	minutes	time.
I			take	you	two		three	minutes	time.
							three minutes

Sentence 273) BLEU: 0 (0.6667/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.75/0.3333/0/0)

Source

��

��n

��

�C

Ref 0

No-smoking,

please.

Ref 1

Please

give

smoking

seat.

Ref 2

Please

seat

the

smoking

section.

Ref 3

Smoking

section

please.

Ref 4

I'd

non-smoking

seat.

Ref 5

seat

non-smoking,

please.

Ref 6

Please

give

no-smoking

seat.

Ref 7

I'd

seat

the

non-smoking

section,

please.

Ref 8

Could

you

give

non-smoking

seat?

Ref 9

Please

give

non-smoking

seat.

Ref 10

Smoking

not

permitted.

Ref 11

You

may

not

smoke.

Ref 12

Kindly

refrain

from

smoking.

Ref 13

Smoking

section,

please.

Ref 14

would

seat

the

smoking

section,

please.

Ref 15

would

smoking

section

seat,

please.

Output 0

Please

don't

smoke.

N-grams

Please	don't	smoke.
Please		smoke.

Output 1

please

not

smoke

N-grams

please	do	not	smoke	.
		not

Output 2

Please

not

smoke.

N-grams

Please	do	not	smoke.
Please		not	smoke.
		not smoke.

Output 3

Please

don't

smoke.

N-grams

Please	don't	smoke.
Please		smoke.

Output 4

Please

not

smoke.

N-grams

Please	do	not	smoke.
Please		not	smoke.
		not smoke.

Sentence 274) BLEU: 1 (1/1/1/1) ; 0 (0.8333/0.4/0/0) ; 1 (1/1/1/1) ; 0 (0.7143/0.5/0.2/0) ; 0 (0.4/0.25/0/0)

Source

��

ĵ�

�b

��

�H

Ref 0

Where

the

nearest

police

station?

Ref 1

Where

the

closest

police

station?

Ref 2

How

get

the

nearest

police

station?

Ref 3

Please

give

directions

the

nearest

police

station.

Ref 4

Where

would

find

the

closest

police

station?

Ref 5

Where

the

nearest

police

station

located?

Ref 6

Where

would

the

closest

police

station

be?

Ref 7

Where

would

the

closest

police

station?

Ref 8

Where

could

find

the

nearest

police

station?

Ref 9

Whereabouts

the

nearest

police

station?

Ref 10

The

nearest

police

station,

please.

Ref 11

Could

you

tell

where

the

closest

police

station

is?

Ref 12

Kindly

direct

the

nearest

police

station.

Ref 13

Where

the

closest

police

station?

Ref 14

Where

can

find

the

closest

police

station?

Ref 15

Where

the

closest

law

enforcement

office?

Output 0

Where

the

nearest

police

station?

N-grams

Where	is	the	nearest	police	station?
Where	is	the	nearest	police	station?
Where is		the nearest		police station?
Where is the			nearest police
Where is the nearest
	is the		nearest police station?
	is the nearest
	is the nearest police
		the nearest police
		the nearest police station?

Output 1

where

the

police

station

N-grams

where	is	the	police	station	?
where	is	the	police	station
	is the		police station

Output 2

Where

the

nearest

police

station?

N-grams

Where	is	the	nearest	police	station?
Where	is	the	nearest	police	station?
Where is		the nearest		police station?
Where is the			nearest police
Where is the nearest
	is the		nearest police station?
	is the nearest
	is the nearest police
		the nearest police
		the nearest police station?

Output 3

Where

the

recent

police

station

N-grams

Where	is	the	recent	police	station	?
Where	is	the		police	station
Where is				police station
Where is the
	is the

Output 4

Recently

police

station

where?

N-grams

Recently	police	station	in	where?
	police	station
	police station

Sentence 275) BLEU: 0 (1/1/1/0) ; 0 (0.3333/0/0/0) ; 0 (1/1/1/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0)

Source

��n

�A

��

�C

Ref 0

No,

thank

you.

Ref 1

No,

I'm

alright.

Ref 2

thanks.

Ref 3

Thanks

but

thanks.

Ref 4

thanks,

I'm

OK.

Ref 5

No,

that's

fine.

Ref 6

Not

for

me,

thanks.

Ref 7

No,

thanks.

Ref 8

No,

don't,

thanks.

Ref 9

thanks,

I'm

fine.

Ref 10

I'm

okay,

thanks.

Ref 11

more,

thanks.

Ref 12

No,

I'm

fine,

thank

you.

Ref 13

Not

for

me,

thank

you.

Ref 14

thanks.

Ref 15

No,

thank

you.

Output 0

No,

thank

you.

N-grams

No,	thank	you.
No,	thank	you.
No, thank
No, thank you.
	thank you.

Output 1

thank

N-grams

,	thank	.
	thank

Output 2

No,

thank

you.

N-grams

No,	thank	you.
No,	thank	you.
No, thank
No, thank you.
	thank you.

Output 3

Don't

thanks.

N-grams

Don't	,	thanks.
		thanks.

Output 4

Does

not

want,

thank.

N-grams

Does

not

want,

thank.

Sentence 276) BLEU: 0 (0.5/0.2/0/0) ; 0 (0.25/0/0/0) ; 0 (1/0.5/0/0) ; 1 (1/1/1/1) ; 0 (0.5/0.2/0/0)

Source

��

�B��

��

�F

�C

Ref 0

friend

injured.

Ref 1

friend

hurt.

Ref 2

friend

wounded.

Ref 3

friend

was

injured.

Ref 4

friend

got

hurt.

Ref 5

friend

was

injured.

Ref 6

friend

has

injury.

Ref 7

friend

has

gotten

injured.

Ref 8

friend

has

injury.

Ref 9

friend

has

been

hurt.

Ref 10

friend's

hurt

herself.

Ref 11

friend

wounded.

Ref 12

friend

has

suffered

injury.

Ref 13

friend

hurt.

Ref 14

friend

has

injury.

Ref 15

friend

has

had

accident.

Output 0

The

friend

mine

was

injured.

N-grams

The	friend	of	mine	was	injured.
	friend			was	injured.
				was injured.

Output 1

friend

injured

N-grams

my	friend	injured	.
	friend

Output 2

friend

injured.

N-grams

My	friend	injured.
My	friend	injured.
My friend

Output 3

friend

got

hurt.

N-grams

My	friend	got	hurt.
My	friend	got	hurt.
My friend		got hurt.
My friend got
My friend got hurt.
	friend got
	friend got hurt.

Output 4

The

friend

mine

was

injured.

N-grams

The	friend	of	mine	was	injured.
	friend			was	injured.
				was injured.

Sentence 277) BLEU: 0 (0.6/0.5/0.3333/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.4/0/0/0) ; 0.6687 (0.8/0.75/0.6667/0.5)

Source

��

�b

�d��y

��

�H

Ref 0

Which

train

stops

Charleston?

Ref 1

Which

train

makes

stop

Charleston?

Ref 2

What

trains

make

stops

Charleston?

Ref 3

Which

one

the

trains

stops

Charleston?

Ref 4

Which

train

makes

stop

Charleston?

Ref 5

What

train

would

stop

Charleston?

Ref 6

Which

train

has

stop

Charleston?

Ref 7

you

know

which

train

stops

Charleston?

Ref 8

What

train

will

stop

Charleston?

Ref 9

Which

train

makes

stop

Charleston?

Ref 10

Which

train

makes

stop

Charleston?

Ref 11

What

trains

stop

Charleston?

Ref 12

Which

are

the

trains

that

stop

Charleston?

Ref 13

Which

train

will

stop

Charleston?

Ref 14

Which

train

will

make

stop

Charleston?

Ref 15

Which

train

will

Charleston?

Output 0

That

train

stops

charleston?

N-grams

That	train	stops	in	charleston?
	train	stops	in
	train stops
	train stops in
		stops in

Output 1

that

train

stop

charleston

N-grams

that	train	stop	in	charleston	?
that	train	stop	in
		stop in

Output 2

That

trip

train

stop

Charleston?

N-grams

That	trip	train	stop	in	Charleston?
		train	stop	in	Charleston?
			stop in
			stop in Charleston?
				in Charleston?

Output 3

that

train

checking

stop?

N-grams

Is	that	train	checking	an	of	Er	Si	to	stop?
	that	train			of			to

Output 4

That

train

stops

Charleston?

N-grams

That	train	stops	in	Charleston?
	train	stops	in	Charleston?
	train stops		in Charleston?
	train stops in
	train stops in Charleston?
		stops in
		stops in Charleston?

Sentence 278) BLEU: 0 (0.8571/0.3333/0.2/0) ; 0 (0.5/0.2/0/0) ; 0 (0.75/0.5714/0.1667/0) ; 0 (0.375/0.2857/0.1667/0) ; 0 (0.8571/0.3333/0.2/0)

Source

��

�@

��

�K�

�ӫ~

��

�H

Ref 0

May

have

list

duty-free

goods?

Ref 1

Can

have

list

the

duty-free

goods?

Ref 2

Can

get

list

the

goods

that

are

duty-free?

Ref 3

Please

give

list

the

duty-free

goods.

Ref 4

Could

see

the

duty-free

list?

Ref 5

Can

have

look

the

duty-free

list?

Ref 6

Could

you

give

the

duty-free

list?

Ref 7

Could

get

list

duty-free

items?

Ref 8

Would

you

give

list

duty-free

items?

Ref 9

Can

see

duty-free

item

list?

Ref 10

Could

you

give

list

duty-free

goods?

Ref 11

I'd

list

duty-free

goods.

Ref 12

Please

hand

list

duty-free

goods.

Ref 13

May

have

list

items

that

are

exempt

from

duty?

Ref 14

Please

give

list

things

that

not

have

pay

duty

on.

Ref 15

get

list

duty

exempt

items?

Output 0

Can

give

free

goods

list?

N-grams

Can	give	me	a	free	goods	list?
Can	give	me	a		goods	list?
	give me
	give me a
		me a

Output 1

merchandise

single

give

N-grams

a	merchandise	single	give	me	?
a			give	me
			give me

Output 2

Could

have

duty-free

merchandise

you

single?

N-grams

Could	I	have	a	duty-free	merchandise	you	single?
Could	I	have	a	duty-free		you
Could I		have a
	I have		a duty-free
	I have a

Output 3

canning

give

tax-free

merchandise

single?

N-grams

Is	canning	give	me	a	tax-free	merchandise	single?
		give	me	a
		give me
		give me a
			me a

Output 4

Can

give

free

goods

list?

N-grams

Can	give	me	a	free	goods	list?
Can	give	me	a		goods	list?
	give me
	give me a
		me a

Sentence 279) BLEU: 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�o��

��

�H

Ref 0

How

about

this

one?

Ref 1

What

about

this

one?

Ref 2

What

you

think

about

this

one?

Ref 3

How

you

this

one?

Ref 4

What

you

think

this

one?

Ref 5

What

about

this

one?

Ref 6

How's

this

one?

Ref 7

What

about

this?

Ref 8

this

your

liking?

Ref 9

How

you

this?

Ref 10

What

you

think

about

this

one?

Ref 11

you

this

one?

Ref 12

Would

you

consider

this

one?

Ref 13

How

about

this

item?

Ref 14

What

you

think

about

this

one?

Ref 15

How

you

this

one?

Output 0

This

what

kind

of?

N-grams

This

what

kind

of?

Output 1

this

how

N-grams

this	how	?
this

Output 2

This

how

to?

N-grams

This

how

to?

Output 3

This

how?

N-grams

This

how?

Output 4

This

what

kind

of?

N-grams

This

what

kind

of?

Sentence 280) BLEU: 1 (1/1/1/1) ; 0 (0.6667/0.4/0.25/0) ; 1 (1/1/1/1) ; 0 (0.75/0.3333/0/0) ; 0 (1/0.6667/0.5/0)

Source

�

�A

��

�O

�K�O

��

�C

Ref 0

No,

it's

free.

Ref 1

No,

comes

free.

Ref 2

No,

free

charge.

Ref 3

No,

there

charge

for

that.

Ref 4

No,

there's

charge.

Ref 5

No,

it's

gratis.

Ref 6

No,

it's

complementary.

Ref 7

No,

there's

charge.

Ref 8

No,

it's

offered

for

free.

Ref 9

No,

you

don't

have

pay

anything.

Ref 10

No,

you

don't

need

pay

for

it.

Ref 11

No,

doesn't

cost

anything.

Ref 12

No,

it's

the

house.

Ref 13

No,

it's

charge.

Ref 14

No,

there's

charge.

Ref 15

No,

doesn't

cost

anything.

Output 0

No,

free

charge.

N-grams

No,	it	is	free	of	charge.
No,	it	is	free	of	charge.
No, it		is free		of charge.
No, it is			free of
No, it is free
	it is		free of charge.
	it is free
	it is free of
		is free of
		is free of charge.

Output 1

free

N-grams

no	,	it	is	free	.
no		it	is	free
		it is
		it is free
			is free

Output 2

No,

free

charge.

N-grams

No,	it	is	free	of	charge.
No,	it	is	free	of	charge.
No, it		is free		of charge.
No, it is			free of
No, it is free
	it is		free of charge.
	it is free
	it is free of
		is free of
		is free of charge.

Output 3

Not,

free.

N-grams

Not,	it	is	free.
	it	is	free.
	it is

Output 4

No,

free.

N-grams

No,	it	is	free.
No,	it	is	free.
No, it
No, it is
	it is

Sentence 281) BLEU: 0 (0.25/0/0/0) ; 0 (0.6667/0/0/0) ; 1 (1/1/1/1) ; 0 (0.25/0/0/0) ; 0 (0.5/0/0/0)

Source

�o��

�O��

��

�S��

��

�F

�C

Ref 0

This

marker

has

run

out

ink.

Ref 1

This

marker

out

ink.

Ref 2

This

marker

has

ink.

Ref 3

This

marker

has

gone

dry.

Ref 4

This

marker

out

ink.

Ref 5

There's

ink

this

marker.

Ref 6

The

ink

this

marker

all

used

up.

Ref 7

There's

ink

left

this

marker.

Ref 8

This

marker

doesn't

have

anymore

ink

it.

Ref 9

This

marker

out

ink.

Ref 10

The

ink

this

marker

has

run

out.

Ref 11

There's

ink

this

marker.

Ref 12

This

marker

has

ink.

Ref 13

This

felt

pen

out

ink.

Ref 14

This

marker

has

ink.

Ref 15

This

marker

longer

writes.

Output 0

This

didn't

was

inky.

N-grams

This	didn't	was	inky.
This

Output 1

this

ink

N-grams

this	ink	.
this	ink

Output 2

This

marker

has

ink.

N-grams

This	marker	has	no	ink.
This	marker	has	no	ink.
This marker		has no
This marker has			no ink.
This marker has no
	marker has
	marker has no
	marker has no ink.
		has no ink.

Output 3

This

didn't

was

inky.

N-grams

This	didn't	was	inky.
This

Output 4

This

symbol

pen

did

not

have

the

ink.

N-grams

This	symbol	pen	did	not	have	the	ink.
This		pen			have		ink.

Sentence 282) BLEU: 0 (0.8571/0.5/0/0) ; 0 (0.5714/0/0/0) ; 0 (0.6/0.1111/0/0) ; 0 (0.8571/0.5/0/0) ; 0 (0.625/0.2857/0/0)

Source

��

�ण��

�n

�M

��

�@��

��

�q��

�H

Ref 0

Can

have

the

same

order

that

one?

Ref 1

Can

have

the

same

dish

that?

Ref 2

want

the

same

dish

that.

Ref 3

Give

the

same

that

dish.

Ref 4

Can

have

the

same

thing

that?

Ref 5

Can

get

the

same

food

that?

Ref 6

Could

have

the

same

that

order?

Ref 7

Can

get

the

same

meal

that?

Ref 8

Would

you

give

the

same

that?

Ref 9

Would

able

get

the

same

whatever

that

meal

is?

Ref 10

I'd

the

same

that

dish.

Ref 11

Could

you

give

the

same

that

dish.

Ref 12

The

same

dish

that,

please.

Ref 13

Can

have

the

same

that?

Ref 14

May

order

the

same

that

over

there?

Ref 15

would

the

same

that

over

there.

Output 0

Can

want

similar

that

order?

N-grams

Can	I	want	similar	to	that	order?
Can	I	want		to	that	order?
Can I					that order?
	I want

Output 1

that

same

can

order

N-grams

i	to	that	same	can	order	?
	to	that	same		order

Output 2

should

not

have

and

that

the

same

orders?

N-grams

I	should	not	have	to	and	that	the	same	orders?
I			have	to		that	the	same
							the same

Output 3

Can

want

similar

that

order?

N-grams

Can	I	want	similar	to	that	order?
Can	I	want		to	that	order?
Can I					that order?
	I want

Output 4

Can

probably

with

that

same

order

form?

N-grams

Can	I	probably	with	that	same	order	form?
Can	I			that	same	order
Can I					same order

Sentence 283) BLEU: 0 (0.6/0.2222/0.125/0) ; 0 (0.6364/0.2/0/0) ; 0 (0.6/0.2222/0.125/0) ; 0 (0.5/0.1538/0/0) ; 0 (0.5/0.1111/0/0)

Source

�A

�Q

�n

�Y

�~��

�t

��

�٬O

��L

��

�H

Ref 0

Would

you

french

fries

something

with

your

burger?

Ref 1

Would

you

french

fries

anything

else

with

your

burger?

Ref 2

Would

you

anything,

french

fries,

with

your

burger?

Ref 3

Would

you

something

else

with

your

burger,

french

fries?

Ref 4

Did

you

want

fries

anything

with

your

burger?

Ref 5

How

about

some

fries

something

with

that

burger?

Ref 6

French

fries

anything

with

your

burger?

Ref 7

How

about

some

fries

anything

else

with

your

burger?

Ref 8

Will

you

having

some

fries

anything

else

with

your

burger?

Ref 9

Would

you

something

with

your

burger

fries?

Ref 10

How

about

some

french

fries

something

with

your

burger?

Ref 11

Could

get

you

some

french

fries

something

with

your

burger?

Ref 12

French

fries

something

with

your

burger,

ma'am?

Ref 13

How

would

you

french

fries

something

with

your

burger?

Ref 14

How

does

french

fries

something

with

your

burger

sound?

Ref 15

May

suggest

french

fries

something

with

your

burger?

Output 0

You

want

eat

hamburger

with

French

fries

other?

N-grams

You	want	to	eat	hamburger	with	French	fries	or	other?
	want	to			with	French	fries	or
						French fries
						French fries or
							fries or

Output 1

you

want

eat

hamburger

with

french

fries

other

N-grams

you	want	to	eat	hamburger	with	french	fries	other	to	?
you	want	to			with	french	fries
you want						french fries

Output 2

You

want

eat

Hamburger

with

French

fries

other?

N-grams

You	want	to	eat	Hamburger	with	French	fries	or	other?
	want	to			with	French	fries	or
						French fries
						French fries or
							fries or

Output 3

your

wanting

eat

hamburger

together

with

French

fries

still

other?

N-grams

your

wanting

eat

hamburger

together

with

French

fries

still

other?

your

to go

with

French

fries

French fries

Output 4

You

want

eat

Hamburg

match

French

fries

other?

N-grams

You	want	to	eat	Hamburg	to	match	French	fries	other?
	want	to					French	fries
							French fries

Sentence 284) BLEU: 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.6/0.5/0/0) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.3333/0.2/0/0)

Source

�藍�_

�C

�A

��

��U

��

�H

Ref 0

Excuse

me.

Can

you

help

me?

Ref 1

Excuse

me.

Could

you

help

me?

Ref 2

Excuse

me.

Please

help

out.

Ref 3

Excuse

me.

Please

give

hand.

Ref 4

Sorry.

Could

ask

you

for

help?

Ref 5

Pardon

me.

Could

you

give

hand?

Ref 6

I'm

sorry.

Could

you

assist

me?

Ref 7

Pardon

me.

Would

you

mind

helping

me?

Ref 8

I'm

sorry.

Could

get

your

assistance?

Ref 9

Excuse

me.

I'd

some

help,

please.

Ref 10

I'm

sorry.

Could

have

some

help,

please?

Ref 11

Sorry,

but

would

you

mind

helping

me?

Ref 12

Sorry

bother

you,

but

I'd

some

help.

Ref 13

Excuse

me.

May

ask

you

for

favor?

Ref 14

Excuse

me.

Could

you

favor?

Ref 15

Excuse

me.

Could

you

something

for

me?

Output 0

Sorry.

Can

you

help

me?

N-grams

Sorry.	Can	you	help	me?
Sorry.	Can	you	help	me?
	Can you		help me?
	Can you help
	Can you help me?
		you help
		you help me?

Output 1

can

you

help

N-grams

can	you	help	me	?
	you	help	me
	you help
		help me

Output 2

不起.

Can

you

help

me?

N-grams

不起.	Can	you	help	me?
	Can	you	help	me?
	Can you		help me?
	Can you help
	Can you help me?
		you help
		you help me?

Output 3

Sorry.

Can

you

help

me?

N-grams

Sorry.	Can	you	help	me?
Sorry.	Can	you	help	me?
	Can you		help me?
	Can you help
	Can you help me?
		you help
		you help me?

Output 4

Being

unfair.

You

can

help

me?

N-grams

Being	unfair.	You	can	help	me?
				help	me?
				help me?

Sentence 285) BLEU: 0 (0.1667/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.1667/0/0/0)

Source

�o

�u

�O

�@

��

�E�

�C

Ref 0

was

really

fun

party.

Ref 1

The

party

was

lot

fun.

Ref 2

really

enjoyed

the

party.

Ref 3

The

party

was

great.

Ref 4

That

party

was

lot

fun.

Ref 5

That

party

was

blast.

Ref 6

was

really

great

party.

Ref 7

What

great

party.

Ref 8

The

party

was

truly

enjoyable.

Ref 9

had

great

time

the

party.

Ref 10

had

really

great

time

the

party.

Ref 11

The

party

was

really

fun

Ref 12

What

fun

party

was.

Ref 13

truly

was

fun

party.

Ref 14

really

was

good

party.

Ref 15

really

was

great

party.

Output 0

This

really

interesting

meeting.

N-grams

This	is	really	an	interesting	meeting.
		really

Output 1

this

really

interesting

N-grams

this	is	really	an	interesting	.
		really

Output 2

This

fun

gathering.

N-grams

This	is	a	fun	gathering.
		a	fun
		a fun

Output 3

This

really

interesting

party.

N-grams

This	is	really	an	interesting	party.
		really			party.

Output 4

This

really

interesting

meeting.

N-grams

This	is	really	an	interesting	meeting.
		really

Sentence 286) BLEU: 0 (0.6667/0.4/0.25/0) ; 0 (0.1667/0/0/0) ; 0 (0.6667/0.4/0.25/0) ; 1 (1/1/1/1) ; 0 (0.5/0/0/0)

Source

��

�S��

�B��

�C

Ref 0

don't

have

prescription.

Ref 1

don't

have

any

prescription.

Ref 2

haven't

got

prescription.

Ref 3

didn't

get

prescription.

Ref 4

I'm

without

prescription.

Ref 5

haven't

been

given

prescription.

Ref 6

I've

prescription.

Ref 7

I'm

without

prescription.

Ref 8

have

prescription.

Ref 9

haven't

been

prescribed

anything.

Ref 10

wasn't

given

prescription.

Ref 11

didn't

get

prescription.

Ref 12

wasn't

given

prescription.

Ref 13

wasn't

prescribed

for

me.

Ref 14

don't

have

prescription.

Ref 15

don't

have

prescription.

Output 0

not

have

prescription.

N-grams

I	do	not	have	a	prescription.
I			have	a	prescription.
			have a
			have a prescription.
				a prescription.

Output 1

not

have

prescription

N-grams

i	do	not	have	prescription	.
			have

Output 2

not

have

prescription.

N-grams

I	do	not	have	a	prescription.
I			have	a	prescription.
			have a
			have a prescription.
				a prescription.

Output 3

have

prescription.

N-grams

I	have	no	prescription.
I	have	no	prescription.
I have		no prescription.
I have no
I have no prescription.
	have no
	have no prescription.

Output 4

not

have

the

prescription.

N-grams

I	do	not	have	the	prescription.
I			have		prescription.

Sentence 287) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�n��

�C

Ref 0

It's

okay.

Ref 1

It's

alright.

Ref 2

worries.

Ref 3

problem.

Ref 4

Don't

worry

about

it.

Ref 5

It's

fine.

Ref 6

It's

all

right.

Ref 7

problem.

Ref 8

It'll

okay.

Ref 9

Don't

worry

about

it.

Ref 10

ahead.

Ref 11

Sure.

Ref 12

problem.

Ref 13

It's

fine.

Ref 14

problem.

Ref 15

Not

problem.

Output 0

Okay.

N-grams

Okay.

Output 1

N-grams

Output 2

好的.

N-grams

好的.

Output 3

Okay.

N-grams

Okay.

Output 4

Good.

N-grams

Good.

Sentence 288) BLEU: 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.6667/0.4/0.25/0) ; 0.7071 (1/0.75/0.6667/0.5) ; 0.7071 (1/0.75/0.6667/0.5) ; 0.5946 (0.875/0.7143/0.5/0.4)

Source

��

�Q

�h

��

�q�@

�C

Ref 0

want

see

opera.

Ref 1

want

opera.

Ref 2

want

and

see

opera.

Ref 3

opera

what

want

and

see.

Ref 4

want

opera.

Ref 5

I'd

see

opera.

Ref 6

I'd

love

opera.

Ref 7

I'd

opera.

Ref 8

I'm

interested

seeing

opera.

Ref 9

wish

see

opera.

Ref 10

I'd

opera.

Ref 11

opera

would

great.

Ref 12

I'm

interested

seeing

opera.

Ref 13

would

see

opera.

Ref 14

would

opera.

Ref 15

would

attend

the

opera.

Output 0

want

see

opera.

N-grams

I	want	to	see	opera.
I	want	to	see	opera.
I want		to see
I want to
I want to see
	want to
	want to see

Output 1

want

see

opera

N-grams

i	want	to	see	opera	.
	want	to	see	opera
	want to
	want to see
		to see

Output 2

want

see

opera.

N-grams

I	want	to	see	opera.
I	want	to	see	opera.
I want		to see
I want to
I want to see
	want to
	want to see

Output 3

want

see

opera.

N-grams

I	want	to	see	opera.
I	want	to	see	opera.
I want		to see
I want to
I want to see
	want to
	want to see

Output 4

want

watch

the

opera.

N-grams

I	want	to	go	to	watch	the	opera.
I	want	to	go	to		the	opera.
I want		to go				the opera.
I want to			go to
I want to go
	want to
	want to go
	want to go to
		to go to

Sentence 289) BLEU: 0 (0.4/0.2222/0.125/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.4/0.2222/0.125/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.6/0/0/0)

Source

�藍�_

�A

�ڭ�

��

�w�g

�w�q

�F

�C

Ref 0

I'm

sorry.

We're

booked

tonight.

Ref 1

apologize.

are

all

filled

tonight.

Ref 2

apologize.

All

our

tables

are

full

tonight.

Ref 3

I'm

sorry.

don't

have

any

empty

tables

tonight.

Ref 4

Sorry,

but

are

all

booked

tonight.

Ref 5

I'm

sorry,

but

have

full

house

this

evening.

Ref 6

Sorry,

but

are

full

tonight.

Ref 7

apologies,

but

we're

completely

booked

tonight.

Ref 8

apologize,

but

there's

nothing

available

tonight.

Ref 9

Sorry,

but

it's

all

full

tonight.

Ref 10

Sorry,

but

all

the

tables

are

booked

up.

Ref 11

I'm

sorry,

but

are

full

tonight.

Ref 12

Sorry,

but

have

free

tables

tonight.

Ref 13

I'm

sorry.

We're

all

full

for

tonight.

Ref 14

I'm

sorry.

This

evening

entirely

booked.

Ref 15

I'm

sorry.

There

nothing

open

tonight.

Output 0

beg

your

pardon,

and

here

have

reservation.

N-grams

I	beg	your	pardon,	and	here	we	have	a	reservation.
I						we	have	a
						we have
						we have a
							have a

Output 1

have

already

tonight

N-grams

,	we	have	already	tonight	.
	we	have
	we have

Output 2

beg

your

pardon,

and

here

have

reservation.

N-grams

I	beg	your	pardon,	and	here	we	have	a	reservation.
I						we	have	a
						we have
						we have a
							have a

Output 3

Execuse

me,

have

already

reserved

tonight.

N-grams

Execuse	me,	we	have	already	reserved	tonight.
		we	have			tonight.
		we have

Output 4

Sorry,

already

ordered

tonight.

N-grams

Sorry,	we	already	ordered	tonight.
Sorry,	we			tonight.

Sentence 290) BLEU: 0 (0.75/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.75/0/0/0) ; 0 (0.3333/0/0/0)

Source

�q

�o��

�X�h

�C

Ref 0

Get

out

here.

Ref 1

Leave.

Ref 2

away.

Ref 3

somewhere

else.

Ref 4

Scram.

Ref 5

Get

lost.

Ref 6

Beat

it.

Ref 7

away.

Ref 8

Leave.

Ref 9

Get

the

hell

out.

Ref 10

Scram.

Ref 11

Get

lost.

Ref 12

Get

out.

Ref 13

Leave.

Ref 14

away.

Ref 15

Scram.

Output 0

out

from

here.

N-grams

Go	out	from	here.
Go	out		here.

Output 1

from

here

out

N-grams

from	here	out	.
		out

Output 2

From

here

out.

N-grams

From	here	out.
		out.

Output 3

out

from

here.

N-grams

Go	out	from	here.
Go	out		here.

Output 4

Exits

from

here.

N-grams

Exits	from	here.
		here.

Sentence 291) BLEU: 1 (1/1/1/1) ; 0 (0.8/0.25/0/0) ; 1 (1/1/1/1) ; 0 (0.75/0.3333/0/0) ; 1 (1/1/1/1)

Source

�o��

�p�M

�O

��

�C

Ref 0

This

knife

dirty.

Ref 1

This

knife

filthy.

Ref 2

This

knife

not

clean.

Ref 3

This

dirty

knife.

Ref 4

This

knife

isn't

clean.

Ref 5

This

knife

has

something

it.

Ref 6

This

knife

needs

washed.

Ref 7

This

dirty

knife.

Ref 8

The

knife

isn't

clean.

Ref 9

The

knife

hasn't

been

cleaned

properly.

Ref 10

There's

something

this

knife.

Ref 11

This

knife

not

clean.

Ref 12

knife

has

some

dirt

it.

Ref 13

This

knife

not

clean.

Ref 14

This

knife

has

something

it.

Ref 15

There

something

this

knife.

Output 0

This

knife

dirty.

N-grams

This	knife	is	dirty.
This	knife	is	dirty.
This knife		is dirty.
This knife is
This knife is dirty.
	knife is
	knife is dirty.

Output 1

this

knife

dirty

N-grams

this	knife	is	dirty	.
this	knife	is	dirty
	knife is

Output 2

This

knife

dirty.

N-grams

This	knife	is	dirty.
This	knife	is	dirty.
This knife		is dirty.
This knife is
This knife is dirty.
	knife is
	knife is dirty.

Output 3

This

penknife

dirty.

N-grams

This	penknife	is	dirty.
This		is	dirty.
		is dirty.

Output 4

This

knife

dirty.

N-grams

This	knife	is	dirty.
This	knife	is	dirty.
This knife		is dirty.
This knife is
This knife is dirty.
	knife is
	knife is dirty.

Sentence 292) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.3333/0/0/0)

Source

�O��

�A

��

�k

�C

Ref 0

Yes,

hurts.

Ref 1

Yes,

painful.

Ref 2

Yes,

that

hurts.

Ref 3

Yes,

killing

me.

Ref 4

Yes,

it's

sore.

Ref 5

Yes,

it's

painful.

Ref 6

Yes,

that

hurts.

Ref 7

Yes,

I'm

pain.

Ref 8

Yes,

it's

painful.

Ref 9

Yes,

feel

pain.

Ref 10

Yes,

it's

painful.

Ref 11

Yes,

I'm

pain.

Ref 12

Yes,

have

pain.

Ref 13

Yes,

it's

painful.

Ref 14

Yes,

feel

pain.

Ref 15

Yes,

there

pain.

Output 0

Yes,

very

painful.

N-grams

Yes,	it	is	very	painful.
Yes,	it	is		painful.
Yes, it
Yes, it is
	it is

Output 1

yes

very

N-grams

yes	,	it	is	very	.
		it	is
		it is

Output 2

Yes,

hurt.

N-grams

Yes,	it	hurt.
Yes,	it
Yes, it

Output 3

Yes,

very

painful.

N-grams

Yes,	it	is	very	painful.
Yes,	it	is		painful.
Yes, it
Yes, it is
	it is

Output 4

very

yes

sore.

N-grams

,	It	is	very	yes	sore.
		is			sore.

Sentence 293) BLEU: 0 (0.6/0.1111/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6/0.1111/0/0) ; 0 (0.4545/0/0/0) ; 0 (0.5833/0/0/0)

Source

��

�Ҧ�

��

��a

��

�s

��

�W�h

��[

�C

Ref 0

Please

store

all

carry-on

baggage

the

overhead

compartments.

Ref 1

Store

all

your

carry-on

bags

the

overhead

compartments,

please.

Ref 2

Please

place

all

your

carry-ons

into

the

overhead

compartments.

Ref 3

Please

put

all

your

carry-ons

into

the

compartments

located

overhead.

Ref 4

Please

put

the

hand-carry

bags

into

the

overhead

compartments.

Ref 5

Please

put

your

carry-ons

into

the

overhead

bins.

Ref 6

Please

stash

your

carry-on

bags

the

bins

overhead.

Ref 7

Could

you

store

your

carry-on

luggage

the

overhead

compartment?

Ref 8

ask

you

put

your

carry-on

luggage

the

overhead

compartments.

Ref 9

You

are

requested

store

your

carry-on

luggage

the

overhead

compartment.

Ref 10

We'd

you

put

your

hand-luggage

the

space

above

you.

Ref 11

request

that

you

place

all

hand-luggage

the

overhead

space

provided.

Ref 12

Kindly

keep

your

hand-luggage

the

compartment

above

your

head.

Ref 13

Please

store

all

your

hand

luggage

the

overhead

storage

bins.

Ref 14

Please

stow

all

your

hand

luggage

the

compartment

overhead.

Ref 15

Please

put

all

your

carry

into

the

overhead

storage

containers.

Output 0

Please

bring

all

its

baggage

onto

the

upper

compartment.

N-grams

Please	bring	all	of	its	baggage	onto	the	upper	compartment.
Please		all	of		baggage		the		compartment.
		all of

Output 1

please

baggage

the

upper

compartment

save

N-grams

please	baggage	the	upper	compartment	to	save	.
	baggage	the		compartment	to

Output 2

Please

bring

all

its

baggage

onto

the

upper

compartment.

N-grams

Please	bring	all	of	its	baggage	onto	the	upper	compartment.
Please		all	of		baggage		the		compartment.
		all of

Output 3

Please

allly

take

baggage

save

the

upper

level

car

compartment.

N-grams

Please	allly	take	baggage	to	save	the	upper	level	car	compartment.
Please			baggage	to		the				compartment.

Output 4

Asks

carry

the

baggage

save

the

top

deck.

N-grams

Asks	it	to	carry	the	baggage	to	save	to	the	top	deck.
		to	carry	the	baggage				the

Sentence 294) BLEU: 0 (0.4/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.4/0/0/0) ; 0 (0.75/0.6667/0.5/0)

Source

��

��V

�O

�_

�H

Ref 0

Which

direction

north?

Ref 1

Which

way

north?

Ref 2

Where

north?

Ref 3

Which

the

ways

north?

Ref 4

North

what

way?

Ref 5

Which

way

north?

Ref 6

Where's

north?

Ref 7

Which

way

would

north?

Ref 8

Could

you

point

north?

Ref 9

Which

north?

Ref 10

Which

way

north?

Ref 11

Where

north?

Ref 12

Could

you

direct

north?

Ref 13

Which

way

north?

Ref 14

which

direction

north?

Ref 15

North

can

found

which

direction?

Output 0

that

direction

north?

N-grams

Is	that	direction	a	north?
		direction		north?

Output 1

that

direction

north

N-grams

that	direction	is	north	?
	direction	is
	direction is

Output 2

That

direction

north?

N-grams

That	direction	is	north?
	direction	is	north?
	direction is
	direction is north?
		is north?

Output 3

that

direction

north?

N-grams

Is	that	direction	a	north?
		direction		north?

Output 4

That

direction

north?

N-grams

That	direction	is	north?
	direction	is	north?
	direction is
	direction is north?
		is north?

Sentence 295) BLEU: 0.7071 (1/0.8333/0.6/0.5) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.6/0.5/0.3333/0) ; 0.7071 (1/0.8333/0.6/0.5) ; 0 (0.5/0.3333/0/0)

Source

�A

�Q

�n

��

�@

��

�H

Ref 0

Would

you

try

on?

Ref 1

you

want

try

on?

Ref 2

Want

try

on?

Ref 3

you

want

try

and

see

fits?

Ref 4

you

want

try

on?

Ref 5

you

want

try

and

see?

Ref 6

Would

you

see

how

looks

you?

Ref 7

Would

you

interested

trying

on?

Ref 8

How

about

trying

on?

Ref 9

you

want

try

on?

Ref 10

Why

don't

you

try

on?

Ref 11

How

about

trying

on?

Ref 12

Maybe

you

should

try

on.

Ref 13

Would

you

see

how

fits?

Ref 14

Would

you

put

on?

Ref 15

Would

you

see

how

fits

you?

Output 0

you

want

try

and

see?

N-grams

Do	you	want	to	try	and	see?
Do	you	want	to	try	and	see?
Do you		want to			and see?
Do you want			to try
Do you want to
	you want
	you want to
	you want to try
		want to try

Output 1

you

want

try

N-grams

you	want	to	try	?
you	want	to	try
you want		to try
you want to
you want to try
	want to
	want to try

Output 2

You

want

try

it?

N-grams

You	want	to	try	it?
	want	to	try
	want to
	want to try
		to try

Output 3

you

want

try

and

see?

N-grams

Do	you	want	to	try	and	see?
Do	you	want	to	try	and	see?
Do you		want to			and see?
Do you want			to try
Do you want to
	you want
	you want to
	you want to try
		want to try

Output 4

You

want

try?

N-grams

You	want	to	try?
	want	to
	want to

Sentence 296) BLEU: 0 (0.75/0.4286/0/0) ; 0 (0.5714/0.1667/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.75/0.4286/0/0) ; 0 (0.5/0/0/0)

Source

�o

��

�Ƨ@��

��

�H

Ref 0

Does

the

medicine

have

any

side

effects?

Ref 1

Are

there

any

side

effects

for

this

medicine?

Ref 2

Does

this

medication

have

side

effects?

Ref 3

Are

there

side

effects?

Ref 4

Does

the

medicine

produce

side

effects?

Ref 5

Will

experience

any

side

effects?

Ref 6

Are

there

any

side

effects

this

medication?

Ref 7

What

are

the

existing

side

effects

this

medicine?

Ref 8

Are

you

aware

any

side

effects

taking

this

medication?

Ref 9

Are

there

any

side

effects

this

medicine?

Ref 10

there

risk

side

effects

with

this

medicine?

Ref 11

there

chance

this

medicine

having

side

effects?

Ref 12

Does

the

medication

produce

any

side

effects?

Ref 13

Are

there

possible

side

effects

from

this

medicine?

Ref 14

Does

the

drug

have

side

effects?

Ref 15

Does

the

medicine

have

any

side

effects?

Output 0

Does

this

kind

medicine

have

side

effect?

N-grams

Does	this	kind	of	medicine	have	side	effect?
Does	this		of	medicine	have	side
Does this				medicine have
					have side

Output 1

the

has

side

this

medicine

effect

N-grams

the	has	side	this	medicine	effect	?
the		side	this	medicine
			this medicine

Output 2

The

drug

has

side

effects?

N-grams

The	drug	has	side	effects?
	drug		side	effects?
			side effects?

Output 3

Does

this

kind

medicine

have

side

effect?

N-grams

Does	this	kind	of	medicine	have	side	effect?
Does	this		of	medicine	have	side
Does this				medicine have
					have side

Output 4

This

medicine

has

the

side

effect?

N-grams

This	medicine	has	the	side	effect?
	medicine		the	side

Sentence 297) BLEU: 0 (0.8/0.5/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.8/0.5/0/0) ; 0 (0.8/0.25/0/0) ; 0 (0.4286/0/0/0)

Source

��

�Pı

�Q

�n

�R

�C

Ref 0

feel

vomiting.

Ref 1

feel

I'm

going

vomit.

Ref 2

think

I'm

going

sick.

Ref 3

feel

nauseous.

Ref 4

think

I'm

going

throw

up.

Ref 5

feel

throwing

up.

Ref 6

think

I'm

going

toss

cookies.

Ref 7

I'm

feeling

nauseous.

Ref 8

I'm

the

verge

throwing

up.

Ref 9

I'm

queasy.

Ref 10

feel

sick.

Ref 11

think

I'm

going

sick.

Ref 12

I'm

nauseous.

Ref 13

feel

throwing

up.

Ref 14

have

nausea.

Ref 15

stomach

feels

ill.

Output 0

feel

want

vomit.

N-grams

I	feel	want	to	vomit.
I	feel		to	vomit.
I feel			to vomit.

Output 1

feel

vomit

wants

N-grams

i	feel	to	vomit	wants	.
	feel	to

Output 2

feel

want

vomit.

N-grams

I	feel	want	to	vomit.
I	feel		to	vomit.
I feel			to vomit.

Output 3

feeling

wants

vomit.

N-grams

My	feeling	wants	to	vomit.
My	feeling		to	vomit.
			to vomit.

Output 4

felt

that

wants

feel

nauseated.

N-grams

I	felt	that	wants	to	feel	nauseated.
I				to	feel

Sentence 298) BLEU: 1 (1/1/1/1) ; 0 (0.6/0.25/0/0) ; 1 (1/1/1/1) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.4/0/0/0)

Source

�o

��M

��

�A

�C

Ref 0

It's

you.

Ref 1

It's

your

decision.

Ref 2

You

decide.

Ref 3

depends

you.

Ref 4

We're

depending

you.

Ref 5

It's

your

hands.

Ref 6

It's

your

baby

now.

Ref 7

Whatever

you

think.

Ref 8

It's

your

decision.

Ref 9

The

decision

yours.

Ref 10

depends

you.

Ref 11

It's

you

decide.

Ref 12

It's

your

decision.

Ref 13

depends

you.

Ref 14

It's

your

decision.

Ref 15

will

dependent

your

decision.

Output 0

depends

you.

N-grams

It	depends	on	you.
It	depends	on	you.
It depends		on you.
It depends on
It depends on you.
	depends on
	depends on you.

Output 1

depends

you

this

N-grams

depends	on	you	this	.
depends	on	you
depends on

Output 2

depends

you.

N-grams

It	depends	on	you.
It	depends	on	you.
It depends		on you.
It depends on
It depends on you.
	depends on
	depends on you.

Output 3

This

depends

you.

N-grams

This	depends	on	you.
	depends	on	you.
	depends on
	depends on you.
		on you.

Output 4

This

decided

you.

N-grams

This	is	decided	by	you.
	is			you.

Sentence 299) BLEU: 0.2346 (0.5/0.2727/0.2/0.1111) ; 0.3156 (0.5556/0.375/0.2857/0.1667) ; 0.5373 (0.7/0.5556/0.5/0.4286) ; 0.2346 (0.5/0.2727/0.2/0.1111) ; 0 (0.3333/0.25/0/0)

Source

�藍�_

�C

�A

��

�i�D

��

�ʦѶ�

��

�H

Ref 0

Excuse

me.

Could

you

tell

the

way

Broadway?

Ref 1

Excuse

but

could

you

tell

how

get

Broadway?

Ref 2

Excuse

me,

but

how

get

Broadway?

Ref 3

Excuse

me,

but

could

you

tell

directions

Broadway?

Ref 4

Sorry,

but

could

you

point

the

direction

Broadway?

Ref 5

Excuse

but

could

you

tell

which

way

Broadway

would

be?

Ref 6

Sorry,

but

could

you

tell

how

get

Broadway?

Ref 7

Pardon

me,

but,

would

you

know

how

get

Broadway?

Ref 8

I'm

sorry,

but,

could

you

give

instructions

how

get

Broadway?

Ref 9

Sorry

bother

you,

but,

how

would

get

Broadway?

Ref 10

Sorry

bother

you,

but

would

you

mind

telling

how

get

Broadway.

Ref 11

Sorry,

but

how

get

Broadway?

Ref 12

I'm

sorry.

Which

way

Broadway?

Ref 13

Excuse

me.

Could

you

tell

which

street

leads

Broadway?

Ref 14

Excuse

me.

Could

you

tell

which

street

will

take

Broadway?

Ref 15

Excuse

me.

Could

you

tell

how

get

Broadway?

Output 0

Sorry.

Can

you

tell

the

road

that

goes

Broadway?

N-grams

Sorry.	Can	you	tell	me	the	road	that	goes	to	a	Broadway?
		you	tell	me	the				to		Broadway?
		you tell		me the
		you tell me
		you tell me the
			tell me
			tell me the

Output 1

can

you

tell

the

broadway

road

N-grams

can	you	tell	me	the	to	broadway	road	?
	you	tell	me	the	to
	you tell		me the
	you tell me
	you tell me the
		tell me
		tell me the

Output 2

不起.

Can

you

tell

the

way

Broadway

it?

N-grams

不起.	Can	you	tell	me	the	way	to	Broadway	it?
		you	tell	me	the	way	to	Broadway
		you tell		me the		way to
		you tell me			the way
		you tell me the
			tell me		the way to
			tell me the
			tell me the way
				me the way
				me the way to

Output 3

Sorry.

Can

you

tell

the

road

that

goes

Broadway?

N-grams

Sorry.	Can	you	tell	me	the	road	that	goes	to	a	Broadway?
		you	tell	me	the				to		Broadway?
		you tell		me the
		you tell me
		you tell me the
			tell me
			tell me the

Output 4

Being

unfair.

You

can

tell

Broadway's

road?

N-grams

Being	unfair.	You	can	tell	me	to	Broadway's	road?
				tell	me	to
				tell me
					me to

Sentence 300) BLEU: 0.6914 (1/0.8571/0.6667/0.4) ; 0.3656 (0.625/0.4286/0.3333/0.2) ; 0.7071 (1/0.8333/0.6/0.5) ; 0.6914 (1/0.8571/0.6667/0.4) ; 0 (0.5/0/0/0)

Source

�A

�@

�p��

��O

�h��

�H

Ref 0

How

much

you

charge

the

hour?

Ref 1

How

much

per

hour?

Ref 2

What

the

hourly

rate?

Ref 3

How

much

does

cost

per

hour?

Ref 4

How

much

per

hour?

Ref 5

What's

the

hourly

rate?

Ref 6

What

you

charge

per

hour?

Ref 7

How

much

for

hour?

Ref 8

How

much

does

cost

per

hour?

Ref 9

What's

the

charge

per

hour?

Ref 10

What's

your

hourly

fee?

Ref 11

How

much

per

hour?

Ref 12

What

the

cost

for

one

hour?

Ref 13

How

much

for

one

hour?

Ref 14

How

much

per

hour?

Ref 15

How

much

one

hour?

Output 0

How

much

you

charge

for

hour?

N-grams

How	much	do	you	charge	for	an	hour?
How	much	do	you	charge	for	an	hour?
How much		do you			for an
How much do			you charge		for an hour?
How much do you						an hour?
	much do
	much do you
	much do you charge
		do you charge

Output 1

how

much

you

charge

hour

N-grams

how	much	do	you	charge	an	hour	?
	much	do	you	charge	an
	much do		you charge
	much do you
	much do you charge
		do you
		do you charge

Output 2

How

much

you

charge

hour?

N-grams

How	much	do	you	charge	an	hour?
How	much	do	you	charge	an	hour?
How much		do you			an hour?
How much do			you charge
How much do you
	much do
	much do you
	much do you charge
		do you charge

Output 3

How

much

you

charge

for

hour?

N-grams

How	much	do	you	charge	for	an	hour?
How	much	do	you	charge	for	an	hour?
How much		do you			for an
How much do			you charge		for an hour?
How much do you						an hour?
	much do
	much do you
	much do you charge
		do you charge

Output 4

How

many

does

your

one

hour

collect

fees?

N-grams

How	many	does	your	one	hour	collect	fees?
How		does	your	one

Sentence 301) BLEU: 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0)

Source

�o

�O

�B�~

��

�H

Ref 0

extra?

Ref 1

that

extra?

Ref 2

there

extra

fee?

Ref 3

Does

that

cost

extra?

Ref 4

you

have

pay

extra

for

that?

Ref 5

there

extra

charge

for

that?

Ref 6

that

additional

charge?

Ref 7

that

additional

charge?

Ref 8

that

charge

separate?

Ref 9

that

surcharge?

Ref 10

have

pay

extra

for

that?

Ref 11

that

not

included

the

price?

Ref 12

that

charged

separately.

Ref 13

that

separate

charge?

Ref 14

that

charge

not

included?

Ref 15

that

additional

charge?

Output 0

This

addition

it?

N-grams

This	is	in	addition	to	it?
		in		to

Output 1

this

N-grams

this

Output 2

This

addition

it?

N-grams

This	is	in	addition	to	it?
		in		to

Output 3

this

additional?

N-grams

Is	this	additional?
Is

Output 4

This

extra?

N-grams

This	is	extra?
		extra?

Sentence 302) BLEU: 1 (1/1/1/1) ; 0 (0.5/0.2857/0/0) ; 0 (0.625/0.2857/0.1667/0) ; 1 (1/1/1/1) ; 0 (0.5/0.2/0/0)

Source

��

�A

��

�@

�M

�@��

��

�H

Ref 0

Can

have

another

cup

coffee?

Ref 1

Can

have

coffee

refill?

Ref 2

Could

you

refill

coffee?

Ref 3

Please

give

coffee

refill.

Ref 4

Could

have

one

cup

coffee,

please?

Ref 5

refill

coffee,

please.

Ref 6

Could

get

refill

the

coffee,

please?

Ref 7

How

about

refill?

Ref 8

Could

get

refill,

please?

Ref 9

Would

you

give

refill,

please?

Ref 10

Could

have

refill

coffee

please?

Ref 11

Would

you

mind

getting

another

coffee?

Ref 12

I'd

coffee

refill.

Ref 13

May

have

refill

coffee?

Ref 14

May

have

some

coffee?

Ref 15

May

get

some

coffee?

Output 0

Can

have

another

cup

coffee?

N-grams

Can	I	have	another	cup	of	coffee?
Can	I	have	another	cup	of	coffee?
Can I		have another		cup of
Can I have			another cup		of coffee?
Can I have another				cup of coffee?
	I have		another cup of
	I have another
	I have another cup
		have another cup
		have another cup of
			another cup of coffee?

Output 1

can

come

cup

coffee

N-grams

i	can	come	a	cup	of	coffee	?
			a	cup	of	coffee
				cup of
					of coffee

Output 2

can

come

cup

coffee?

N-grams

I	can	come	to	a	cup	of	coffee?
I				a	cup	of	coffee?
					cup of
					cup of coffee?
						of coffee?

Output 3

Can

have

another

cup

coffee?

N-grams

Can	I	have	another	cup	of	coffee?
Can	I	have	another	cup	of	coffee?
Can I		have another		cup of
Can I have			another cup		of coffee?
Can I have another				cup of coffee?
	I have		another cup of
	I have another
	I have another cup
		have another cup
		have another cup of
			another cup of coffee?

Output 4

can

come

coffee

again?

N-grams

I	can	come	a	coffee	again?
I			a	coffee
			a coffee

Sentence 303) BLEU: 0 (0.5714/0.1667/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.5714/0.1667/0/0) ; 0 (0.8333/0.6/0.25/0) ; 0 (0.5/0.2/0/0)

Source

��

�մ�

�o��

��Ҫo

��

�H

Ref 0

Can

exchange

this

nail

polish?

Ref 1

Can

get

exchange

for

this

nail

polish?

Ref 2

want

exchange

this

nail

polish.

Ref 3

want

exchange

this

nail

polish

for

another.

Ref 4

Can

return

this

nail

polish

for

something

else?

Ref 5

Can

get

something

else

exchange

for

this

nail

polish?

Ref 6

possible

exchange

this

nail

polish?

Ref 7

Would

you

exchange

this

nail

polish?

Ref 8

Would

you

allow

exchange

this

nail

polish?

Ref 9

Can

this

nail

polish

exchanged?

Ref 10

I'd

exchange

this

nail

polish.

Ref 11

Could

have

different

nail

polish

please?

Ref 12

Would

you

mind

exchanging

this

nail

polish

for

me?

Ref 13

May

change

this

nail

polish?

Ref 14

May

exchange

this

nail

enamel?

Ref 15

Could

trade

this

nail

polish?

Output 0

can

change

the

nail

polish

it?

N-grams

I	can	change	the	nail	polish	it?
I		change		nail	polish
				nail polish

Output 1

can

nail

polish

this

N-grams

i	can	nail	polish	this	?
		nail	polish	this
		nail polish

Output 2

can

change

the

nail

polish

it?

N-grams

I	can	change	the	nail	polish	it?
I		change		nail	polish
				nail polish

Output 3

Can

transpose

this

nail

polish?

N-grams

Can	I	transpose	this	nail	polish?
Can	I		this	nail	polish?
Can I			this nail
			this nail polish?
				nail polish?

Output 4

can

exchange

this

cuticle

cream?

N-grams

I	can	exchange	this	cuticle	cream?
I		exchange	this
		exchange this

Sentence 304) BLEU: 1 (1/1/1/1) ; 0 (0.3333/0/0/0) ; 1 (1/1/1/1) ; 0 (0.3333/0/0/0) ; 0 (0.6/0.25/0/0)

Source

��n

��

��a

�C

Ref 0

Keep

off

the

grass.

Ref 1

Stay

off

the

grass.

Ref 2

not

walk

the

grass.

Ref 3

Stay

off

the

grass.

Ref 4

Don't

walk

the

grass.

Ref 5

Stay

away

from

the

grass.

Ref 6

Please

stay

off

the

grass.

Ref 7

Don't

into

the

lawned

area.

Ref 8

Don't

step

onto

the

grass,

please.

Ref 9

Don't

walk

the

grass.

Ref 10

walking

the

grass.

Ref 11

Stay

away

from

the

grass.

Ref 12

Stay

off

the

grass.

Ref 13

not

the

grass.

Ref 14

not

step

the

grass.

Ref 15

Keep

off

the

grass.

Output 0

not

walk

the

grass.

N-grams

Do	not	walk	on	the	grass.
Do	not	walk	on	the	grass.
Do not		walk on		the grass.
Do not walk			on the
Do not walk on
	not walk		on the grass.
	not walk on
	not walk on the
		walk on the
		walk on the grass.

Output 1

not

the

trample

lawn

N-grams

do	not	the	trample	lawn	.
	not	the

Output 2

not

walk

the

grass.

N-grams

Do	not	walk	on	the	grass.
Do	not	walk	on	the	grass.
Do not		walk on		the grass.
Do not walk			on the
Do not walk on
	not walk		on the grass.
	not walk on
	not walk on the
		walk on the
		walk on the grass.

Output 3

Don't

trample

lawn.

N-grams

Don't	trample	lawn.
Don't

Output 4

not

trample

the

lawn.

N-grams

Do	not	trample	the	lawn.
Do	not		the
Do not

Sentence 305) BLEU: 0 (0.75/0.4286/0.1667/0) ; 0 (0.7143/0.5/0.2/0) ; 0 (0.75/0.4286/0.1667/0) ; 0 (0.5556/0.25/0.1429/0) ; 0 (0.7143/0.5/0.2/0)

Source

��

�~

�i

��

�A

�@

�]

��

�C

Ref 0

Two

bottles

bourbon

and

carton

cigarettes.

Ref 1

have

two

bottles

bourbon

and

carton

cigarettes.

Ref 2

Two

bottles

bourbon

and

one

carton

cigarettes.

Ref 3

carrying

two

bottles

bourbon

and

one

carton

cigarettes.

Ref 4

have

two

bottles

bourbon

plus

one

carton

cigarettes.

Ref 5

There's

couple

bottles

bourbon

and

carton

cigarettes.

Ref 6

I've

got

couple

bottles

bourbon

and

one

carton

cigarettes.

Ref 7

have

two

bottles

bourbon

and

one

carton

cigarettes.

Ref 8

I'm

bringing

two

bottles

bourbon

and

one

carton

cigarettes.

Ref 9

I've

got

two

bottles

bourbon

and

carton

cigarettes.

Ref 10

have

two

bottles

bourbon

and

carton

cigarettes.

Ref 11

Two

bottles

bourbon

and

carton

cigarettes

are

all

have.

Ref 12

Only

two

bottles

bourbon

and

carton

cigarettes.

Ref 13

couple

bottles

whiskey

and

one

carton

cigarettes.

Ref 14

There

are

two

bottles

whiskey

and

one

carton

cigarettes.

Ref 15

Two

bourbon

and

one

carton

cigarettes.

Output 0

Two

bottles

bourbon,

one

packet

cigarettes.

N-grams

Two	bottles	of	bourbon,	one	packet	of	cigarettes.
Two	bottles	of		one		of	cigarettes.
Two bottles						of cigarettes.
Two bottles of
	bottles of

Output 1

two

bottles

cigarettes

N-grams

two	bottles	of	,	of	cigarettes	.
two	bottles	of		of	cigarettes
two bottles				of cigarettes
two bottles of
	bottles of

Output 2

Two

bottles

bourbon,

one

packet

cigarettes.

N-grams

Two	bottles	of	bourbon,	one	packet	of	cigarettes.
Two	bottles	of		one		of	cigarettes.
Two bottles						of cigarettes.
Two bottles of
	bottles of

Output 3

Two

bottles

waves

side,

pack

cigarette.

N-grams

Two	bottles	of	waves	side,	a	pack	of	cigarette.
Two	bottles	of			a		of
Two bottles
Two bottles of
	bottles of

Output 4

Two

bottles

bourbons,

package

cigarettes.

N-grams

Two	bottles	of	bourbons,	package	of	cigarettes.
Two	bottles	of			of	cigarettes.
Two bottles					of cigarettes.
Two bottles of
	bottles of

Sentence 306) BLEU: 0 (0.375/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.5/0.1429/0/0) ; 0.2985 (0.4444/0.375/0.2857/0.1667) ; 0 (0.4286/0.1667/0/0)

Source

��

�P

��

�H

Ref 0

Could

speak

Mr.

Moore,

please?

Ref 1

Can

speak

Mr.

Moore,

please?

Ref 2

Can

talk

with

Mr.

Moore,

please?

Ref 3

Mr.

Moore,

please.

Ref 4

I'd

speak

with

Mr.

Moore,

please.

Ref 5

May

please

talk

with

Mr.

Moore?

Ref 6

Mr.

Moore,

please.

Ref 7

I'd

speak

Mr.

Moore,

please.

Ref 8

Mr.

Moore

there?

Ref 9

Mr.

Moore

available?

Ref 10

I'd

speak

Mr.

Moore.

Ref 11

Could

you

put

through

Mr.

Moore?

Ref 12

Mr.

Moore

there?

Ref 13

May

have

Mr.

Moore,

please?

Ref 14

Could

connect

Mr.

Moore,

please?

Ref 15

May

talk

Mr.

Moore,

please?

Output 0

can

with

his

speech,

Mr.

moore?

N-grams

I	can	do	with	his	speech,	Mr.	moore?
I			with			Mr.

Output 1

can

with

N-grams

i	can	with	of	?
		with

Output 2

can

with

his

speech,

Mr.

Moore?

N-grams

I	can	do	with	his	speech,	Mr.	Moore?
I			with			Mr.	Moore?
						Mr. Moore?

Output 3

Can

talk

with

the

Sir

Er?

N-grams

Can	I	talk	with	the	Sir	of	Mo	Er?
Can	I	talk	with
Can I		talk with
Can I talk
Can I talk with
	I talk
	I talk with

Output 4

can

speak

with

mole

gentleman?

N-grams

I	can	speak	with	mole	of	gentleman?
I		speak	with
		speak with

Sentence 307) BLEU: 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�C

Ref 0

Pardon

me.

Ref 1

Excuse

me.

Ref 2

I'm

sorry.

Ref 3

I	apologize.

Ref 4

Sorry.

Ref 5

Excuse

me.

Ref 6

beg

your

pardon.

Ref 7

Excuse

me.

Ref 8

Sorry.

Ref 9

My	apologies.

Ref 10

Excuse

me.

Ref 11

I'm

sorry.

Ref 12

Sorry

bother

you.

Ref 13

Excuse

me.

Ref 14

Sorry.

Ref 15

beg

your

pardon.

Output 0

Forgive

me.

N-grams

Forgive	me.
	me.

Output 1

forgive

N-grams

forgive

Output 2

Forgive

me.

N-grams

Forgive	me.
	me.

Output 3

Forgive

me.

N-grams

Forgive	me.
	me.

Output 4

Forgives

me.

N-grams

Forgives	me.
	me.

Sentence 308) BLEU: 0 (0.5/0.2/0/0) ; 0 (0.4/0/0/0) ; 0 (0.75/0/0/0) ; 0 (0.5714/0.1667/0/0) ; 0 (0.5/0.2/0/0)

Source

��

��y

��

ĵ�

�b

��

�H

Ref 0

Where

police

station

where

Japanese

understood?

Ref 1

Where

there

police

station

where

Japanese

understood?

Ref 2

you

know

where

police

station

with

Japanese

interpreter

located?

Ref 3

Where

there

police

station

where

they

can

understand

Japanese?

Ref 4

Where

would

find

police

station

where

they

understand

Japanese?

Ref 5

Where

there

police

station

where

can

communicate

Japanese?

Ref 6

Where's

police

station

that

Japanese

spoken?

Ref 7

you

know

police

station

where

can

communicate

Japanese?

Ref 8

Where

could

find

police

station

where

Japanese

might

understood?

Ref 9

Where

police

station

where

communicating

Japanese

would

possible?

Ref 10

Please

tell

where

there

police

station

where

Japanese

understood?

Ref 11

Where

can

find

police

station

where

can

communicate

Japanese?

Ref 12

Kindly

direct

police

station

where

can

speak

someone

Japanese.

Ref 13

Where

could

find

police

station

where

someone

can

speak

Japanese?

Ref 14

Where

would

there

police

station

that

would

have

someone

who

could

understand

Japanese?

Ref 15

Where

could

find

police

station

that

has

Japanese

translator?

Output 0

Understands

Japanese

the

police

station

in?

N-grams

Understands	Japanese	the	police	station	in?
	Japanese		police	station
			police station

Output 1

japanese

police

the

station

N-grams

japanese	police	the	station	?
	police		station

Output 2

Japanese

police

know

where?

N-grams

Japanese	police	know	where?
Japanese	police	know

Output 3

Understand

the

police

station

Japanese

which?

N-grams

Understand	the	police	station	of	Japanese	which?
		police	station	of	Japanese
		police station

Output 4

Understands

Japanese

the

police

station

in?

N-grams

Understands	Japanese	the	police	station	in?
	Japanese		police	station
			police station

Sentence 309) BLEU: 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.5/0.2/0/0) ; 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.8333/0.6/0.25/0) ; 0 (0.3333/0/0/0)

Source

��

�Ͱ�s

�C

Ref 0

Draft

beer,

please.

Ref 1

One

draft

beer,

please.

Ref 2

Please

bring

one

draft

beer.

Ref 3

I'd

draft

beer,

please.

Ref 4

Please

bring

draft

beer.

Ref 5

I'd

beer

tap.

Ref 6

Please

give

draft

beer.

Ref 7

I'd

tap

beer,

please.

Ref 8

Give

draft,

please.

Ref 9

Could

you

give

something

tap,

please?

Ref 10

I'd

draft

beer.

Ref 11

Get

draft

beer.

Ref 12

want

draft

beer.

Ref 13

would

draft

beer,

please.

Ref 14

would

what's

tap,

please.

Ref 15

would

draft,

please.

Output 0

Please

give

beer.

N-grams

Please	give	me	a	beer.
Please	give	me	a	beer.
Please give		me a
Please give me
Please give me a
	give me
	give me a

Output 1

please

give

beer

the

N-grams

please	give	me	beer	the	.
	give	me	beer
	give me

Output 2

Please

give

beer.

N-grams

Please	give	me	a	beer.
Please	give	me	a	beer.
Please give		me a
Please give me
Please give me a
	give me
	give me a

Output 3

Please

give

the

draft

beer.

N-grams

Please	give	me	the	draft	beer.
Please	give	me		draft	beer.
Please give				draft beer.
Please give me
	give me

Output 4

Please

live

the

beer

me.

N-grams

Please	live	the	beer	to	me.
Please			beer

Sentence 310) BLEU: 0.2004 (0.5263/0.2778/0.1765/0.0625) ; 0 (0.4706/0.0625/0/0) ; 0.2126 (0.5556/0.2941/0.1875/0.06667) ; 0.2912 (0.6111/0.3529/0.25/0.1333) ; 0 (0.3889/0.1765/0.0625/0)

Source

�n��

�C

��

�

��

�C

�p�G

��

�ή�

��F

�A

��

�ڭ�

��[

�H��

�A

�E

�@

��

�C

Ref 0

Okay.

I'll

that.

can't

make

it,

let's

get

together

again

sometime

soon.

Ref 1

Alright,

I'll

that.

not

able

make

it,

let's

get

together

again

sometime

soon.

Ref 2

OK,

I'll

that.

can't

then

let's

get

together

soon.

Ref 3

OK,

I'll

that.

unable

then

let's

get

together

again

sometime

soon.

Ref 4

Sure,

that's

what

I'll

do.

doesn't

work

out,

let's

meet

again

sometime

soon.

Ref 5

That's

fine,

that's

what

I'll

do.

can't

though,

how

about

getting

together

again

the

near

future.

Ref 6

Sure

thing,

I'll

that.

But,

things

don't

work

out,

let's

plan

getting

together

again

soon.

Ref 7

Alright,

I'll

sure

to.

doesn't

pan

out,

though,

let's

get

together

the

near

future.

Ref 8

Got

it,

will.

can't

work

out,

then

can

meet

again

the

near

future?

Ref 9

Okey

dokey,

I'll

that.

doesn't

seem

possibility,

then

let's

meet

soon.

Ref 10

Alright.

That's

what

I'll

do.

things

don't

work

out,let's

meet

another

time

soon.

Ref 11

Sure.

I'll

it.

schedule

does

not

permit

it,

can

meet

again

soon.

Ref 12

Understood.

I'm

otherwise

engaged,

let's

arrange

meet

soon.

Ref 13

understand.

will

that

way.

circumstances

don't

work

out

for

me,

let's

get

together

sometime

soon.

Ref 14

understand.

Let's

that

way.

timing

bad

for

me,

let's

get

together

again

soon.

Ref 15

get

it.

will

that

way.

doesn't

work

out,

let's

get

together

again

the

near

future.

Output 0

好�\x9A\x84.

will

that.

can

not

arrive

time,

Let

shortly

after

the

first

\xE5\x86\x8D\xE8\x81\x9A.

N-grams

好�\x9A\x84.

will

that.

can

not

arrive

time,

Let

shortly

after

the

first

\xE5\x86\x8D\xE8\x81\x9A.

will

that.

can

not

the

I will

do that.

If I

I will do

that. If

will do

that. If I

do that. If

do that. If I

Output 1

will

that

can

arrive

time

let

after

soon

again

N-grams

will

that

can

arrive

time

let

after

soon

again

will

that

can

time

again

will do

Output 2

好的.

will

that.

can

not

arrive

time,

let

shortly

after

the

first再聚.

N-grams

好的.

will

that.

can

not

arrive

time,

let

shortly

after

the

first再聚.

will

that.

can

not

the

I will

do that.

If I

I will do

that. If

will do

that. If I

do that. If

do that. If I

Output 3

Okay.

will

that.

can't

arrive

time,

let

soon

hereafter

gather

again

once.

N-grams

Okay.

will

that.

can't

arrive

time,

let

soon

hereafter

gather

again

once.

Okay.

will

that.

can't

again

I will

do that.

If I

I will do

that. If

I can't

will do

that. If I

do that. If

do that. If I

that. If I can't

If I can't

Output 4

Good.

will

make

that.

cannot

arrive

promptly,

lets

soon

after

again

poly

one

time.

N-grams

Good.

will

make

that.

cannot

arrive

promptly,

lets

soon

after

again

poly

one

time.

will

make

that.

again

I will

that. If

that. If I

If I

Sentence 311) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.25/0/0/0) ; 0 (0/0/0/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0/0/0/0)

Source

��

�b

��

�H

Ref 0

Where

the

market?

Ref 1

Where

the

market

located?

Ref 2

you

know

where

the

market

is?

Ref 3

Where

can

find

the

market?

Ref 4

Where

would

the

market

be?

Ref 5

Where

would

find

the

market?

Ref 6

Where's

the

market

located?

Ref 7

Could

you

tell

where

the

market

is?

Ref 8

Where

the

market

located?

Ref 9

Whereabouts

the

market?

Ref 10

Where

can

find

the

market?

Ref 11

Could

you

please

tell

where

the

market

is?

Ref 12

Would

you

mind

showing

where

the

market

is?

Ref 13

Where

can

find

the

market?

Ref 14

Where

the

market

located?

Ref 15

Where

the

city

market?

Output 0

Which

the

market?

N-grams

Which	is	the	market?
	is	the	market?
	is the
	is the market?
		the market?

Output 1

market

which

N-grams

market	in	which	?
market

Output 2

Market

which?

N-grams

Market

which?

Output 3

Which

the

market

N-grams

Which	is	the	market	?
	is	the	market
	is the
	is the market
		the market

Output 4

Market

in?

N-grams

Market

in?

Sentence 312) BLEU: 0.4111 (0.75/0.5714/0.3333/0.2) ; 0 (0.5/0.2/0/0) ; 0 (0.6/0.25/0/0) ; 0.4111 (0.75/0.5714/0.3333/0.2) ; 0 (0.6/0/0/0)

Source

�A

��

�K�y

�@��

��

�ж�

��

�H

Ref 0

you

have

cheaper

room?

Ref 1

you

have

room

that

cheaper?

Ref 2

there

cheaper

room?

Ref 3

there

room

that

doesn't

cost

much?

Ref 4

there

cheaper

room?

Ref 5

you

have

room

for

less?

Ref 6

you

have

less

expensive

room?

Ref 7

there

cheaper

room?

Ref 8

Would

you

have

room

that's

cheaper?

Ref 9

Have

you

cheaper

room?

Ref 10

Have

you

got

cheaper

room?

Ref 11

Have

you

any

cheaper

rooms?

Ref 12

I'd

cheaper

room

please.

Ref 13

you

have

room

that

less

expensive?

Ref 14

you

have

room

that

less

costly?

Ref 15

there

cheaper

room

available?

Output 0

you

have

little

bit

cheaper

rooms?

N-grams

Do	you	have	a	little	bit	cheaper	rooms?
Do	you	have	a			cheaper	rooms?
Do you		have a				cheaper rooms?
Do you have
Do you have a
	you have
	you have a

Output 1

you

have

some

cheaper

rooms

N-grams

you	have	some	cheaper	rooms	?
you	have		cheaper
you have

Output 2

You

have

some

cheaper

room?

N-grams

You	have	some	cheaper	room?
	have		cheaper	room?
			cheaper room?

Output 3

you

have

little

bit

cheaper

rooms?

N-grams

Do	you	have	a	little	bit	cheaper	rooms?
Do	you	have	a			cheaper	rooms?
Do you		have a				cheaper rooms?
Do you have
Do you have a
	you have
	you have a

Output 4

You

have

cheaper

some

rooms?

N-grams

You	have	cheaper	some	rooms?
	have	cheaper		rooms?

Sentence 313) BLEU: 0 (0.6364/0.3/0.1111/0) ; 0 (0.7/0.3333/0.125/0) ; 0.6105 (0.7778/0.625/0.5714/0.5) ; 0 (0.6364/0.3/0.1111/0) ; 0 (0.6364/0.2/0/0)

Source

��

�ܤ�

�b

��}

�e

�@

�p��

��

�n�O

�B

�C

Ref 0

Please

come

the

check-in

counter

least

one

hour

before

departure

time.

Ref 1

Please

come

the

check-in

counter

least

one

hour

before

your

departure

time.

Ref 2

least

one

hour

before

your

departure

time,

please

come

the

check-in

counter.

Ref 3

least

hour

before

your

departure

time,

please

the

check-in

counter.

Ref 4

Please

come

the

check-in

counter

later

than

one

hour

before

the

departure

time.

Ref 5

Please

the

check-in

counter

least

hour

ahead

the

departure

time.

Ref 6

Please

arrive

the

check-in

counter

later

than

one

hour

advance

the

departure

time.

Ref 7

You

are

required

the

check-in

counter

least

one

hour

before

your

flight

time.

Ref 8

request

that

you

come

the

check-in

counter

minimum

one

hour

before

departure

time.

Ref 9

Please

ensure

that

you

arrive

the

check-in

counter

least

one

hour

before

departure

time.

Ref 10

Come

the

check-in

desk

within

hour

before

departure.

Ref 11

Make

your

way

the

check-in

counter

least

one

hour

before

departing.

Ref 12

You

need

come

the

check-in

counter

than

one

hour

before

you're

due

depart.

Ref 13

Please

report

the

check-in

counter

least

hour

before

departure

time.

Ref 14

Please

check-in

least

hour

before

the

scheduled

departure

time.

Ref 15

Please

report

check-in

least

hour

before

the

plane

scheduled

leave.

Output 0

Please

registry

for

hour

before

leaving

least.

N-grams

Please	go	to	registry	for	an	hour	before	leaving	at	least.
Please	go	to			an	hour	before		at
	go to				an hour
					an hour before
						hour before

Output 1

please

least

hour

before

the

registry

leaving

N-grams

please	at	least	hour	before	the	registry	to	leaving	.
please	at	least	hour	before	the		to
	at least		hour before
			hour before the
				before the

Output 2

Please

leave

least

one

hour

before

the

Registry.

N-grams

Please	leave	at	least	one	hour	before	the	Registry.
Please		at	least	one	hour	before	the
		at least		one hour		before the
		at least one			hour before
		at least one hour
			least one		hour before the
			least one hour
			least one hour before
				one hour before
				one hour before the

Output 3

Please

registry

for

hour

before

leaving

least.

N-grams

Please	go	to	registry	for	an	hour	before	leaving	at	least.
Please	go	to			an	hour	before		at
	go to				an hour
					an hour before
						hour before

Output 4

Please

least

leaving

preceding

hour

the

registration

office.

N-grams

Please	at	least	be	leaving	preceding	hour	to	the	registration	office.
Please	at	least	be			hour	to	the
	at least						to the

Sentence 314) BLEU: 0 (0.6111/0.1765/0.0625/0) ; 0 (0.6667/0.09091/0/0) ; 0 (0.5789/0.1667/0/0) ; 0 (0.5/0.06667/0/0) ; 0 (0.6111/0.1765/0.0625/0)

Source

��

�d�i

�b

��

�H

�A

��

�e

�@

�i

�h

��

�a��

��

�H

Ref 0

Where

the

ticket

counter?

Could

you

please

draw

map

there?

Ref 1

Where

the

ticket

counter?

Would

you

draw

map

how

get

there?

Ref 2

Where

the

ticket

counter

located?

Could

you

draw

map

it?

Ref 3

Where

the

ticket

counter?

Please

draw

map.

Ref 4

Where

would

the

ticket

counter

be?

Could

you

please

make

map

how

get

there?

Ref 5

Where

the

ticket

counter

located?

you

think

you

could

sketch

map

that

shows

how

get

there?

Ref 6

Where

can

find

the

ticket

counter?

possible

for

you

make

map

showing

the

way?

Ref 7

Where

can

find

the

ticket

counter?

you

mind

drawing

map

how

get

there?

Ref 8

Whereabouts

the

ticket

counter?

Would

you

draw

map

there?

Ref 9

Where

the

location

the

ticket

counter?

Could

bother

you

draw

map

there?

Ref 10

Where

can

find

the

ticket

desk?

Would

you

mind

drawing

map

how

get

there?

Ref 11

Where

would

the

ticket

counter

be?

I'd

you

draw

map

the

way

there.

Ref 12

Could

you

tell

where

the

ticket

counter

is?

Please

draw

map

there.

Ref 13

Where

are

tickets

sold?

Could

you

please

draw

directions

how

get

there?

Ref 14

Where

the

ticket

sales

office?

Could

you

please

draw

map

how

get

there?

Ref 15

Where

the

ticket

wicket?

Could

you

please

draw

instructions

how

get

there?

Output 0

Sells

the

ticket

counter

in?

There

you

can

give

draw

one

the

map?

N-grams

Sells

the

ticket

counter

in?

There

you

can

give

draw

one

the

map?

the

ticket

counter

you

can

draw

the

the ticket

to draw

the ticket counter

ticket counter

Output 1

ticket

counter

can

you

give

the

map

there

N-grams

a	ticket	counter	can	you	give	me	the	map	go	there	?
a	ticket	counter	can	you		me	the	map
	ticket counter

Output 2

Such

selling

ticket

counter

where?

Can

you

give

painting

the

map

you

there?

N-grams

Such

selling

ticket

counter

where?

Can

you

give

painting

the

map

you

there?

ticket

counter

you

the

map

you

there?

ticket counter

me a

of the

Output 3

Sell

counter

which?

Can

you

give

the

map

that

makes

uniform

Zhang

Qu4

there?

N-grams

Sell

counter

which?

Can

you

give

the

map

that

makes

uniform

Zhang

Qu4

there?

counter

you

the

map

that

there?

map that

Output 4

Sells

the

ticket

counter

in?

There

you

can

give

draw

one

the

map?

N-grams

Sells

the

ticket

counter

in?

There

you

can

give

draw

one

the

map?

the

ticket

counter

you

can

draw

the

the ticket

to draw

the ticket counter

ticket counter

Sentence 315) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.4/0.25/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.75/0.6667/0.5/0)

Source

��

�Q

�n

�@��

�ѱ�

�C

Ref 0

I'd

some

needles.

Ref 1

want

some

needles.

Ref 2

Some

needles,

please.

Ref 3

looking

for

some

needles.

Ref 4

need

some

needles.

Ref 5

want

get

some

needles.

Ref 6

I'm

need

some

needles.

Ref 7

I'm

looking

for

some

needles.

Ref 8

I'd

get

some

needles.

Ref 9

want

purchase

some

needles.

Ref 10

want

some

needles.

Ref 11

Could

please

have

some

needles?

Ref 12

Needles,

please.

Ref 13

would

buy

some

needles.

Ref 14

looking

for

needles.

Ref 15

would

get

needles.

Output 0

want

some

noodles.

N-grams

I	want	some	noodles.
I	want	some
I want
I want some
	want some

Output 1

want

some

noodles

N-grams

i	want	some	noodles	.
	want	some
	want some

Output 2

want

some

noodles.

N-grams

I	want	some	noodles.
I	want	some
I want
I want some
	want some

Output 3

want

some

noodles.

N-grams

I	want	some	noodles.
I	want	some
I want
I want some
	want some

Output 4

want

some

noodles.

N-grams

I	want	some	noodles.
I	want	some
I want
I want some
	want some

Sentence 316) BLEU: 1 (1/1/1/1) ; 0 (0.5714/0.3333/0.2/0) ; 0.7071 (1/0.75/0.6667/0.5) ; 1 (1/1/1/1) ; 1 (1/1/1/1)

Source

�A

�Q

��

�ɭ�

��}

�H

Ref 0

When

would

you

leave?

Ref 1

When

you

want

leave?

Ref 2

What

departure

date

would

you

like?

Ref 3

When

you

plan

departing?

Ref 4

When

you

want

go?

Ref 5

When

would

you

depart?

Ref 6

When

you

want

take

off?

Ref 7

When

you

plan

leave?

Ref 8

What

date

would

you

depart?

Ref 9

When

your

intended

departure

date?

Ref 10

When

are

you

planning

leave?

Ref 11

When

will

you

depart?

Ref 12

What

your

departure

time?

Ref 13

When

would

you

leaving?

Ref 14

When

your

departure?

Ref 15

When

you

plan

depart?

Output 0

When

you

want

leave?

N-grams

When	do	you	want	to	leave?
When	do	you	want	to	leave?
When do		you want		to leave?
When do you			want to
When do you want
	do you		want to leave?
	do you want
	do you want to
		you want to
		you want to leave?

Output 1

when

you

want

leave

N-grams

when	you	want	to	leave	do	?
	you	want	to		do
	you want
	you want to
		want to

Output 2

When

you

want

leave?

N-grams

When	you	want	to	leave?
When	you	want	to	leave?
	you want		to leave?
	you want to
	you want to leave?
		want to
		want to leave?

Output 3

When

you

want

leave?

N-grams

When	do	you	want	to	leave?
When	do	you	want	to	leave?
When do		you want		to leave?
When do you			want to
When do you want
	do you		want to leave?
	do you want
	do you want to
		you want to
		you want to leave?

Output 4

When

you

want

leave?

N-grams

When	do	you	want	to	leave?
When	do	you	want	to	leave?
When do		you want		to leave?
When do you			want to
When do you want
	do you		want to leave?
	do you want
	do you want to
		you want to
		you want to leave?

Sentence 317) BLEU: 0.8409 (1/0.8333/0.8/0.75) ; 0.6435 (0.8571/0.6667/0.6/0.5) ; 0.8409 (1/0.8333/0.8/0.75) ; 0.8409 (1/0.8333/0.8/0.75) ; 0 (0.6667/0.2/0/0)

Source

��

�i�D

��

�p��

��g

�C

Ref 0

Please

tell

how

fill

out.

Ref 1

Please

tell

how

fill

this

in.

Ref 2

Please

tell

how

complete

this

form.

Ref 3

Please

show

how

fill

out

this

form.

Ref 4

Could

you

please

show

how

write

this?

Ref 5

Could

you

explain

how

fill

in?

Ref 6

Could

you

give

some

help

how

fill

out?

Ref 7

Would

you

show

how

fill

in?

Ref 8

Would

you

mind

showing

how

fill

this

out?

Ref 9

I'd

appreciate

you

could

tell

how

fill

this

out.

Ref 10

Would

you

mind

showing

how

fill

this

in?

Ref 11

I'd

you

show

what

should

write.

Ref 12

Could

you

show

the

way

fill

this

in?

Ref 13

Please

show

how

write

this.

Ref 14

Please

explain

how

fill

this

in.

Ref 15

Please

explain

how

write

this

form.

Output 0

Please

tell

how

fill

out.

N-grams

Please	tell	me	how	to	fill	out.
Please	tell	me	how	to	fill	out.
Please tell		me how		to fill
Please tell me			how to
Please tell me how
	tell me		how to fill
	tell me how
	tell me how to
		me how to
		me how to fill

Output 1

please

tell

how

fill

N-grams

please	tell	me	how	to	fill	.
please	tell	me	how	to	fill
	tell me		how to
	tell me how			to fill
	tell me how to
		me how
		me how to
		me how to fill
			how to fill

Output 2

Please

tell

how

fill

out.

N-grams

Please	tell	me	how	to	fill	out.
Please	tell	me	how	to	fill	out.
Please tell		me how		to fill
Please tell me			how to
Please tell me how
	tell me		how to fill
	tell me how
	tell me how to
		me how to
		me how to fill

Output 3

Please

tell

how

fill

in.

N-grams

Please	tell	me	how	to	fill	in.
Please	tell	me	how	to	fill	in.
Please tell		me how		to fill
Please tell me			how to
Please tell me how
	tell me		how to fill
	tell me how
	tell me how to
		me how to
		me how to fill

Output 4

How

please

tell

fill.

N-grams

How	please	tell	me	to	fill.
	please	tell	me	to
		tell me

Sentence 318) BLEU: 0 (0.625/0.1429/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.625/0.1429/0/0) ; 0 (0/0/0/0)

Source

j��

�A

��

�A

�٬O

�p��

�H

Ref 0

Large,

medium,

small?

Ref 1

Would

you

large,

medium,

small?

Ref 2

Can

get

you

large,

medium,

small?

Ref 3

Would

you

that

large,

medium,

small

size?

Ref 4

Will

large,

medium,

small?

Ref 5

that

going

large,

medium,

small?

Ref 6

that

large,

medium,

small?

Ref 7

Will

that

large,

medium,

small?

Ref 8

Would

you

large,

medium,

small?

Ref 9

What

will

be,

large,

medium,

small?

Ref 10

Would

you

that

large,

medium,

small?

Ref 11

Would

you

prefer

large,

medium,

small

size?

Ref 12

Would

that

large,

medium,

small?

Ref 13

Would

you

large,

medium

small

size?

Ref 14

Would

you

prefer

large,

medium

small?

Ref 15

you

want

large,

medium

small?

Output 0

the

large,

the

medium,

still

small?

N-grams

Is	the	large,	the	medium,	still	a	small?
Is		large,		medium,		a	small?
						a small?

Output 1

large

medium

trumpet

N-grams

large	,	medium	,	trumpet	?
		medium

Output 2

Large,

medium,

trumpet?

N-grams

Large,	medium,	or	trumpet?
Large,	medium,	or
Large, medium,
Large, medium, or
	medium, or

Output 3

the

large,

the

medium,

still

small?

N-grams

Is	the	large,	the	medium,	still	a	small?
Is		large,		medium,		a	small?
						a small?

Output 4

Large

size,

medium-sized,

trumpet?

N-grams

Large

size,

medium-sized,

trumpet?

Sentence 319) BLEU: 0 (0.375/0.1429/0/0) ; 0 (0.5714/0.3333/0/0) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.4/0.1111/0/0) ; 0 (0.375/0.1429/0/0)

Source

�A

�Q

�n

�H

�@��

�}�G

��~

�}�l

��

�H

Ref 0

Would

you

appetizer

start

with?

Ref 1

Would

you

start

out

with

appetizer?

Ref 2

Would

you

start

with

appetizer?

Ref 3

Would

you

appetizer

begin

with?

Ref 4

Would

you

start

off

with

appetizer?

Ref 5

Would

you

appetizer

begin

with?

Ref 6

Would

you

want

have

appetizer

start?

Ref 7

Would

you

start

with

your

appetizer?

Ref 8

Would

your

preference

start

with

appetizers?

Ref 9

Shall

start

with

appetizers?

Ref 10

Would

you

begin

with

appetizer?

Ref 11

How

about

starting

with

appetizer?

Ref 12

you

want

appetizer

start?

Ref 13

begin,

would

you

appetizer?

Ref 14

How

does

appetizer

sound?

Ref 15

start

off,

how

about

appetizer?

Output 0

You

want

some

hors

d'oeuvre

start?

N-grams

You	want	by	some	hors	d'oeuvre	to	start?
	want					to	start?
						to start?

Output 1

you

want

some

food

start

N-grams

you	want	some	food	to	start	?
you	want			to	start
you want				to start

Output 2

You

want

some

food

appetizer

start?

N-grams

You	want	some	food	appetizer	to	start?
	want			appetizer	to	start?
				appetizer to
				appetizer to start?
					to start?

Output 3

You

want

with

some

open

stomach

food

start?

N-grams

You	want	with	some	open	a	stomach	food	to	start?
	want	with						to	start?
								to start?

Output 4

You

want

some

hors

d'oeuvre

start?

N-grams

You	want	by	some	hors	d'oeuvre	to	start?
	want					to	start?
						to start?

Sentence 320) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.75/0.6667/0.5/0) ; 0 (0.4/0/0/0) ; 0 (0.75/0.3333/0/0)

Source

�o

�O

��

�O��

�H

Ref 0

What

this

charge

for?

Ref 1

What

does

this

pay

for?

Ref 2

Why

this

charge

here?

Ref 3

What

the

reason

for

this

charge?

Ref 4

What's

this

charge?

Ref 5

What

charge

this?

Ref 6

What

being

billed

for

here?

Ref 7

What

being

charged

for

here?

Ref 8

Could

you

tell

what

this

charge

for?

Ref 9

What

are

these

charges?

Ref 10

Could

you

explain

what

this

amount

for?

Ref 11

Please

specify

this

amount.

Ref 12

I'd

know

what

this

amount

for.

Ref 13

What

this

charge?

Ref 14

What

this

bill

for?

Ref 15

What

this

charge

meant

be?

Output 0

What

the

cost?

N-grams

What	is	the	cost?
What	is	the
What is
What is the
	is the

Output 1

what

this

N-grams

what	is	this	?
what	is	this
	is this

Output 2

What

the

cost?

N-grams

What	is	the	cost?
What	is	the
What is
What is the
	is the

Output 3

This

what

expenses?

N-grams

This	is	what	of	expenses?
	is	what

Output 4

What

expense

this?

N-grams

What	expense	is	this?
What		is	this?
		is this?

Sentence 321) BLEU: 0 (0.7143/0.5/0.2/0) ; 0 (0.6/0.25/0/0) ; 0 (0.7143/0.5/0.2/0) ; 0 (0.6/0.25/0/0) ; 0.4347 (0.7143/0.5/0.4/0.25)

Source

��

�@

�d

��

�{��

�C

Ref 0

have

one

thousand

dollars

cash.

Ref 1

have

one

thousand

cash.

Ref 2

I've

got

one

thousand

cash.

Ref 3

have

thousand

dollars

with

cash.

Ref 4

cash,

I'm

carrying

one

thousand

dollars.

Ref 5

I've

got

one

thousand

dollars

cash

with

me.

Ref 6

I've

got

thousand

dollars

cash.

Ref 7

cash,

one

thousand

dollars.

Ref 8

I've

got

one

thousand

dollars

cash

with

me.

Ref 9

I'm

carrying

one

thousand

dollars

cash.

Ref 10

I've

got

one

thousand

dollars

cash.

Ref 11

One

thousand

dollars

cash.

Ref 12

have

thousand

dollars

cash

me.

Ref 13

have

thousand

dollars

cash.

Ref 14

carrying

thousand

dollars

cash.

Ref 15

currently

possess

thousand

dollars

cash.

Output 0

have

1000

U.S.

dollars

cash.

N-grams

I	have	1000	U.S.	dollars	in	cash.
I	have			dollars	in	cash.
I have				dollars in
				dollars in cash.
					in cash.

Output 1

have

dollars

cash

N-grams

i	have	dollars	cash	.
	have	dollars	cash
		dollars cash

Output 2

have

1000

U.S.

dollars

cash.

N-grams

I	have	1000	U.S.	dollars	in	cash.
I	have			dollars	in	cash.
I have				dollars in
				dollars in cash.
					in cash.

Output 3

have

USD

1,000

cash.

N-grams

I	have	USD	1,000	cash.
I	have			cash.
I have

Output 4

have

one

thousand

dollars

cashes.

N-grams

I	have	one	thousand	US	dollars	cashes.
I	have	one	thousand		dollars
I have		one thousand
I have one
I have one thousand
	have one
	have one thousand

Sentence 322) BLEU: 0.4526 (0.9231/0.4167/0.3636/0.3) ; 0 (0.7/0/0/0) ; 0 (0.6364/0.1/0/0) ; 0 (0.5385/0.08333/0/0) ; 0.4526 (0.9231/0.4167/0.3636/0.3)

Source

��

��I

��

�C

��

��L

��

��Z

��

�A

��

�H

Ref 0

That's

kind

long.

there

anything

else

that's

bothering

you?

Ref 1

That's

little

long.

there

anything

else

that

wrong

with

you?

Ref 2

That

pretty

long.

you

have

anything

else

that

bothering

you?

Ref 3

That

little

bit

long.

Anything

else

bothering

you?

Ref 4

It's

bit

long.

there

anything

else

that

you

feel

strange?

Ref 5

It's

rather

long.

there

any

other

part

that

you

feel

funny

about?

Ref 6

It's

kind

long.

there

anything

else

that

you

don't

about

it?

Ref 7

That

seems

long.

you

have

any

other

unusual

symptoms?

Ref 8

That

does

seem

lengthy.

Have

you

noticed

anything

else

unusual?

Ref 9

It's

sort

long

time.

Are

you

experiencing

any

other

strange

symptoms?

Ref 10

That's

little

long.

What

else

bothering

you?

Ref 11

That's

quite

long.

you

feel

strange

anywhere

else?

Ref 12

little

long.

Can

you

describe

any

other

strange

symptoms?

Ref 13

That

bit

too

long.

there

anything

else

that

seems

strange?

Ref 14

That

bit

long.

there

anything

else

out

the

ordinary?

Ref 15

too

long.

there

anything

else

that

feels

funny?

Output 0

That

little

long.

What

does

that

have

other

disturb

you?

N-grams

That

little

long.

What

does

that

have

other

disturb

you?

That

little

long.

What

does

that

have

other

you?

That is

a little

long. What

That is a

little long.

That is a little

is a

little long. What

is a little

is a little long.

a little long.

a little long. What

Output 1

that

little

what

has

other

you

that

N-grams

that	little	what	has	other	to	you	a	that	?
that	little			other	to	you	a

Output 2

That

little

bit

longer.

What

has

other

disturbing

you?

N-grams

That	little	bit	longer.	What	it	has	other	disturbing	to	you?
That	little	bit		What			other		to	you?
	little bit

Output 3

That

has

little

grow.

That

has

other

what

bother

yours?

N-grams

That

has

little

grow.

That

has

other

what

bother

yours?

That

little

other

a little

Output 4

That

little

long.

What

does

that

have

other

disturb

you?

N-grams

That

little

long.

What

does

that

have

other

disturb

you?

That

little

long.

What

does

that

have

other

you?

That is

a little

long. What

That is a

little long.

That is a little

is a

little long. What

is a little

is a little long.

a little long.

a little long. What

Sentence 323) BLEU: 0 (0.25/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.2/0/0/0)

Source

��

�ڭ�

��}

��

�C

Ref 0

Let's

split

it.

Ref 1

Shall

split

it?

Ref 2

Shall

split

the

bill?

Ref 3

Let's

split

the

bill.

Ref 4

Let's

Dutch.

Ref 5

Let's

make

half

and

half.

Ref 6

Let's

it.

Ref 7

How

about

splitting

it.

Ref 8

Why

don't

just

split

it?

Ref 9

Shall

split

it?

Ref 10

Let's

split

the

bill.

Ref 11

Let's

dutch.

Ref 12

Let's

fifty-fifty.

Ref 13

Let's

split

the

bill.

Ref 14

I'll

half

with

you.

Ref 15

Let's

halfers.

Output 0

Let

open

it.

N-grams

Let	us	open	it.
			it.

Output 1

let

open

cut

N-grams

let	us	open	it	cut	.
			it

Output 2

Let

open

it.

N-grams

Let	us	open	it.
			it.

Output 3

Let

cut

open

it.

N-grams

Let	us	cut	open	it.
				it.

Output 4

Let

cut

open

it.

N-grams

Let	us	cut	open	it.
				it.

Sentence 324) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

�o��

�C

Ref 0

For

here.

Ref 1

I'll

have

here.

Ref 2

I'll

eat

here.

Ref 3

I'll

eat

here.

Ref 4

I'll

have

here.

Ref 5

I'll

eat

here.

Ref 6

I'll

eating

here.

Ref 7

I'd

have

here.

Ref 8

have

here.

Ref 9

I'm

eating

here.

Ref 10

I'm

eating

in.

Ref 11

For

eating

in.

Ref 12

I'll

eat

here.

Ref 13

will

eating

in.

Ref 14

Eat

in.

Ref 15

will

dining

here.

Output 0

Here.

N-grams

Here.

Output 1

here

N-grams

here

Output 2

這裡.

N-grams

這裡.

Output 3

Here.

N-grams

Here.

Output 4

Here.

N-grams

Here.

Sentence 325) BLEU: 0.7068 (0.9444/0.8235/0.6875/0.4667) ; 0.2818 (0.7059/0.3125/0.2/0.1429) ; 0.7068 (0.9444/0.8235/0.6875/0.4667) ; 0.3578 (0.7647/0.5625/0.2667/0.1429) ; 0 (0.6429/0.3077/0.08333/0)

Source

�b

�c

��

�C

��

�o

�L�h

��

�Ȧ�

�䲼

��

�o��

�c

�I��

�C

Ref 0

the

shoe

department.

had

show

pay

for

these

shoes

with

traveler's

checks.

Ref 1

the

shoe

department.

had

show

order

buy

these

shoes

with

traveler's

checks.

Ref 2

the

shoe

store.

buy

shoes

with

traveler's

checks,

had

show

it.

Ref 3

the

shoe

department.

order

pay

for

shoes

with

traveler's

checks

had

show

it.

Ref 4

the

shoe

section.

had

show

order

able

pay

for

the

shoes

traveler's

check.

Ref 5

It's

shoes.

had

give

them

look

that

could

pay

for

the

shoes

with

traveler's

checks.

Ref 6

the

shoe

shop.

have

let

them

see

could

pay

for

the

shoes

credit

card.

Ref 7

The

shoe

department.

was

asked

present

when

paying

for

these

shoes

with

traveler's

checks

Ref 8

the

shoe

section.

They

asked

show

when

paid

for

these

shoes

with

traveler's

checks.

Ref 9

shoes.

They

made

show

when

paying

for

these

shoes

with

traveler's

checks.

Ref 10

the

shoe

section.

was

required

show

use

traveler's

checks

pay

for

these

shoes.

Ref 11

the

shoe

place.

needed

present

pay

for

these

shoes

with

traveler's

checks.

Ref 12

Where

they

sell

shoes.

paid

for

these

shoes

using

traveler's

checks

was

necessary

show

it.

Ref 13

Where

they

sell

shoes.

paid

with

traveler's

checks

had

show

when

purchased

the

shoes.

Ref 14

the

shoe

sales.

had

present

when

paid

for

the

shoes

with

traveler's

check.

Ref 15

the

shoe

sales

area.

Because

paid

for

these

shoes

with

traveler's

check,

had

show

then.

Output 0

the

shoe

department.

have

the

past

with

traveler's

checks

pay

for

these

shoes.

N-grams

the

shoe

department.

have

the

past

with

traveler's

checks

pay

for

these

shoes.

the

shoe

department.

have

the

with

traveler's

checks

pay

for

these

shoes.

In the

shoe department.

I have

with my

traveler's checks

to pay

for these

In the shoe

department. I

have to

with my traveler's

checks to

pay for

these shoes.

In the shoe department.

I have to

my traveler's

checks to pay

for these shoes.

the shoe

my traveler's checks

to pay for

the shoe department.

my traveler's checks to

pay for these

the shoe department. I

traveler's checks to

pay for these shoes.

shoe department. I

traveler's checks to pay

checks to pay for

to pay for these

Output 1

the

department

have

pay

for

these

shoes

use

check

shoes

N-grams

the

department

have

pay

for

these

shoes

use

check

shoes

the

have

pay

for

these

shoes

use

have to

to pay

for these

to pay for

these shoes

to pay for these

pay for

pay for these

pay for these shoes

for these shoes

Output 2

the

shoe

department.

have

the

past

with

traveler's

checks

pay

for

these

shoes.

N-grams

the

shoe

department.

have

the

past

with

traveler's

checks

pay

for

these

shoes.

the

shoe

department.

have

the

with

traveler's

checks

pay

for

these

shoes.

In the

shoe department.

I have

with my

traveler's checks

to pay

for these

In the shoe

department. I

have to

with my traveler's

checks to

pay for

these shoes.

In the shoe department.

I have to

my traveler's

checks to pay

for these shoes.

the shoe

my traveler's checks

to pay for

the shoe department.

my traveler's checks to

pay for these

the shoe department. I

traveler's checks to

pay for these shoes.

shoe department. I

traveler's checks to pay

checks to pay for

to pay for these

Output 3

the

shoes

department.I

have

use

trip

check

pay

for

these

shoes.

N-grams

the

shoes

department.I

have

use

trip

check

pay

for

these

shoes.

the

shoes

have

use

pay

for

these

shoes.

In the

have to

to use

to pay

for these

the shoes

to use my

to pay for

these shoes.

use my

to pay for these

pay for

pay for these

pay for these shoes.

for these shoes.

Output 4

shoes

department.

must

pass

use

traller's

check

for

these

shoes

payment.

N-grams

shoes

department.

must

pass

use

traller's

check

for

these

shoes

payment.

shoes

department.

use

for

these

department. I

use my

for these

for these shoes

these shoes

Sentence 326) BLEU: 0 (0.2222/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.5/0.1429/0/0) ; 0 (0.75/0.4286/0.1667/0) ; 0 (0.2222/0/0/0)

Source

�A

��

�i

�Ӥ�

��

�H

Ref 0

Would

you

take

picture,

please?

Ref 1

Would

you

please

take

picture?

Ref 2

Could

you

take

picture?

Ref 3

Would

you

take

picture

for

me?

Ref 4

Could

you

take

picture

for

me,

please?

Ref 5

Would

you

mind

taking

picture

for

me?

Ref 6

Could

ask

you

take

picture

for

me?

Ref 7

you

mind

taking

photo,

please?

Ref 8

Could

bother

you

take

picture,

please?

Ref 9

Can

ask

you

take

picture?

Ref 10

Please

could

you

take

picture?

Ref 11

Would

you

mind

taking

photo?

Ref 12

Could

you

take

photo

for

me?

Ref 13

Would

you

mind

taking

picture

for

me,

please?

Ref 14

Could

you

snap

photo

for

me,

please?

Ref 15

Could

you

take

photograph

for

me,

please?

Output 0

You

can

help

according

open

the

picture?

N-grams

You	can	help	me	according	to	open	the	picture?
					to			picture?

Output 1

you

help

according

can

N-grams

you	help	me	according	to	can	?
you				to

Output 2

Would

you

help

according

photos?

N-grams

Would	you	help	me	according	to	my	photos?
Would	you				to	my
Would you

Output 3

Can

you

shine

photograph

for

me?

N-grams

Can	you	shine	on	a	photograph	for	me?
Can	you			a	photograph	for	me?
				a photograph		for me?
				a photograph for
					photograph for

Output 4

You

can

help

according

open

the

picture?

N-grams

You	can	help	me	according	to	open	the	picture?
					to			picture?

Sentence 327) BLEU: 0.3814 (0.8889/0.5/0.2857/0.1667) ; 0 (0.3333/0.125/0/0) ; 0.3549 (0.6667/0.5/0.2857/0.1667) ; 0.3814 (0.8889/0.5/0.2857/0.1667) ; 0 (0.5/0.1429/0/0)

Source

��

�Ӭ۾�

��

�b

�o

�F

�A

��

�F

�C

Ref 0

left

camera

here

and

it's

gone.

Ref 1

left

camera

here

and

now

it's

gone.

Ref 2

left

the

camera

here

but

now

gone.

Ref 3

It's

gone

now,

but

left

the

camera

here.

Ref 4

The

camera

left

here

has

disappeared.

Ref 5

camera

that

left

here

gone.

Ref 6

left

camera

here

and

it's

vanished.

Ref 7

The

camera

had

left

here

has

disappeared.

Ref 8

had

put

camera

here

and

now

it's

disappeared.

Ref 9

camera

placed

here

missing.

Ref 10

The

camera

left

here

has

disappeared.

Ref 11

can't

find

the

camera

left

here.

Ref 12

left

camera

here,

but

now

it's

gone

missing.

Ref 13

put

camera

down

here

and

then

disappeared.

Ref 14

put

camera

here

and

then

was

gone.

Ref 15

The

camera

put

down

here

disappeared.

Output 0

fell

camera

here

and

was

missing.

N-grams

I	fell	my	camera	here	and	it	was	missing.
I		my	camera	here	and	it	was	missing.
		my camera		here and		it was
		my camera here
		my camera here and
			camera here
			camera here and

Output 1

camera

fell

disappeared

N-grams

i	my	camera	fell	on	it	,	disappeared	.
	my	camera			it
	my camera

Output 2

put

camera

fell

it,

disappeared.

N-grams

I	put	my	camera	fell	on	it,	it	disappeared.
I	put	my	camera				it	disappeared.
I put		my camera					it disappeared.
I put my
I put my camera
	put my
	put my camera

Output 3

fell

camera

here

and

was

missing.

N-grams

I	fell	my	camera	here	and	it	was	missing.
I		my	camera	here	and	it	was	missing.
		my camera		here and		it was
		my camera here
		my camera here and
			camera here
			camera here and

Output 4

fell

mine

camera

this,

disappeared.

N-grams

I	fell	mine	camera	on	this,	it	disappeared.
I			camera			it	disappeared.
						it disappeared.

Sentence 328) BLEU: 0 (0.5556/0.375/0.1429/0) ; 0 (0.3333/0.125/0/0) ; 0 (0.5556/0.375/0.1429/0) ; 0 (0.4444/0.125/0/0) ; 0 (0.5714/0.1667/0/0)

Source

��

�Q

�n

�@

��

��D

��

�n

��

�C

Ref 0

I'd

good

restaurant

with

reasonable

prices.

Ref 1

I'd

good

restaurant

that

has

reasonable

prices.

Ref 2

I'd

restaurant

that

good

with

reasonable

prices.

Ref 3

I'd

reasonably

priced,

good

restaurant.

Ref 4

I'm

hoping

find

restaurant

that

has

great

food

reasonable

price.

Ref 5

want

reasonably-priced

restaurant

with

good

food.

Ref 6

want

restaurant

with

decent

prices

and

excellent

food.

Ref 7

reasonably-priced

good

restaurant

would

nice.

Ref 8

I'm

hoping

for

good

restaurant

that's

moderately

priced.

Ref 9

want

nice

restaurant

with

good

prices.

Ref 10

prefer

affordable

restaurant

with

good

food.

Ref 11

restaurant

with

good

food

and

reasonable

prices

would

good.

Ref 12

want

good

and

affordable

restaurant.

Ref 13

would

find

good

restaurant

that

isn't

too

expensive.

Ref 14

would

good

affordable

restaurant.

Ref 15

would

delicious

and

affordable

restaurant.

Output 0

want

fair

price

good

hotel.

N-grams

I	want	a	fair	price	of	a	good	hotel.
I	want	a				a	good
I want						a good
I want a
	want a

Output 1

want

price

good

hotel

the

N-grams

i	want	a	price	of	good	hotel	the	.
	want	a			good
	want a

Output 2

want

fair

price

good

hotel.

N-grams

I	want	a	fair	price	of	a	good	hotel.
I	want	a				a	good
I want						a good
I want a
	want a

Output 3

want

the

good

hotel

price

justice.

N-grams

I	want	the	good	hotel	of	a	price	justice.
I	want		good			a
I want

Output 4

want

reasonable

price

the

good

hotel.

N-grams

I	want	reasonable	price	the	good	hotel.
I	want	reasonable			good
I want

Sentence 329) BLEU: 0.32 (0.7692/0.5/0.2727/0.1) ; 0 (0.4545/0.2/0.1111/0) ; 0.32 (0.7692/0.5/0.2727/0.1) ; 0.2346 (0.5/0.2727/0.2/0.1111) ; 0 (0.5/0.1111/0/0)

Source

��

�Q

�h

�A

��O

��

�h

�C

Ref 0

I'd

love

to,

but

I'm

afraid

can't.

Ref 1

want

to,

but

sorry

say

that

can't.

Ref 2

I'd

to,

but

I'm

afraid

can't.

Ref 3

I'd

love

to,

but

sorry

say

that

won't

able

to.

Ref 4

really

want

but

unfortunately,

can't.

Ref 5

I'd

really

to,

but

I'm

sorry

say

that

can't.

Ref 6

would

really

to,

but

regrettably,

can't.

Ref 7

That's

what

I'd

do,

but

unfortunately

can't.

Ref 8

really

want

to,

but

regrettably

can't.

Ref 9

That's

what

want,

but

unfortunately

it's

just

not

possibility.

Ref 10

I'd

that,

but

unfortunately

can't.

Ref 11

Although

would

to,

sadly

I'm

not

able

to.

Ref 12

would

nice

that,

but

regret

that

can't.

Ref 13

would

for

you

but

it's

too

bad

that

can't.

Ref 14

would

for

you

but

unfortunately,

can't.

Ref 15

would

for

you

but

unfortunately,

not

permitted

to.

Output 0

really

want

go,

but

afraid

should

not

go.

N-grams

really

want

go,

but

afraid

should

not

go.

really

want

but

afraid

not

I really

want to

but I

afraid I

I really want

but I am

I really want to

I am

really want

really want to

Output 1

really

want

but

afraid

N-grams

i	really	want	to	go	,	but	i	afraid	go	.
	really	want	to			but		afraid
	really want
	really want to
		want to

Output 2

really

want

go,

but

afraid

should

not

go.

N-grams

really

want

go,

but

afraid

should

not

go.

really

want

but

afraid

not

I really

want to

but I

afraid I

I really want

but I am

I really want to

I am

really want

really want to

Output 3

really

want

go,

but

afraid

and

can't

go.

N-grams

I	really	want	to	go,	but	afraid	of	me	and	can't	go.
I	really	want	to		but	afraid
I really		want to
I really want
I really want to
	really want
	really want to

Output 4

very

want

go,

but

perhaps

cannot

go.

N-grams

I	very	want	to	go,	but	perhaps	I	cannot	go.
I		want	to		but		I
		want to

Sentence 330) BLEU: 1 (1/1/1/1) ; 0 (0.5/0/0/0) ; 1 (1/1/1/1) ; 0 (0.6/0/0/0) ; 0 (0.75/0.3333/0/0)

Source

��

��l

��

�F

�C

Ref 0

have

stuffed-up

nose.

Ref 1

nose

stuffed-up.

Ref 2

have

stuffy

nose.

Ref 3

I'm

suffering

from

stuffed-up

nose.

Ref 4

nose

stuffed

up.

Ref 5

nose

plugged

up.

Ref 6

have

plugged

nose.

Ref 7

nose

stuffed

up.

Ref 8

I've

got

plugged

nose.

Ref 9

nose

plugged.

Ref 10

nose

stuffy.

Ref 11

nose

blocked-up.

Ref 12

have

blocked-up

nose.

Ref 13

have

blocked

nose.

Ref 14

nose

stuffy.

Ref 15

nose

plugged.

Output 0

have

stuffy

nose.

N-grams

I	have	a	stuffy	nose.
I	have	a	stuffy	nose.
I have		a stuffy
I have a			stuffy nose.
I have a stuffy
	have a
	have a stuffy
	have a stuffy nose.
		a stuffy nose.

Output 1

nose

N-grams

nose	my	up	.
nose		up

Output 2

have

stuffy

nose.

N-grams

I	have	a	stuffy	nose.
I	have	a	stuffy	nose.
I have		a stuffy
I have a			stuffy nose.
I have a stuffy
	have a
	have a stuffy
	have a stuffy nose.
		a stuffy nose.

Output 3

The

nose

blocked

up.

N-grams

The	my	nose	blocked	up.
		nose	blocked	up.

Output 4

nose

stopped

up.

N-grams

My	nose	stopped	up.
My	nose		up.
My nose

Sentence 331) BLEU: 0 (0.7143/0.3333/0.2/0) ; 0 (0.4286/0/0/0) ; 0 (0.7143/0.3333/0.2/0) ; 0 (0.6667/0/0/0) ; 0 (0.6667/0.2/0/0)

Source

�̶}�԰�ù

��

�ۦW

�@�~

�]

�b

�i�X

��

�H

Ref 0

Are

the

famous

works

Michelangelo

display,

too?

Ref 1

Are

Michelangelo's

famous

works

display,

too?

Ref 2

Are

they

also

displaying

famous

works

Michelangelo?

Ref 3

Are

famous

works

Michelangelo

also

being

displayed?

Ref 4

Are

Michelangelo's

most

well-known

works

also

display?

Ref 5

Are

they

also

displaying

the

famous

works

Michelangelo?

Ref 6

Are

they

also

showing

Michelangelo's

most

famous

works?

Ref 7

Would

Michelangelo's

famous

pieces

also

display?

Ref 8

they

have

Michelangelo's

famous

pieces

also

display?

Ref 9

there

also

display

the

famous

pieces

Michelangelo?

Ref 10

Are

the

famous

works

Michelangelo

also

displayed?

Ref 11

Are

there

also

famous

works

Michelangelo

display?

Ref 12

you

have

Michelangelo's

famous

works

display?

Ref 13

Are

famous

works

Michelangelo

also

being

show,

too?

Ref 14

famous

art

Michelangelo

also

being

displayed?

Ref 15

Are

well

known

works

Michelangelo

also

being

shown?

Output 0

Michelangelo's

famous

works

are

display

it?

N-grams

Michelangelo's	famous	works	are	on	display	it?
Michelangelo's	famous	works		on	display
Michelangelo's famous
Michelangelo's famous works
	famous works

Output 1

michelangelo

famous

display

work

also

N-grams

michelangelo	's	famous	display	work	also	?
		famous	display		also

Output 2

Michelangelo's

famous

works

are

display

it?

N-grams

Michelangelo's	famous	works	are	on	display	it?
Michelangelo's	famous	works		on	display
Michelangelo's famous
Michelangelo's famous works
	famous works

Output 3

Michelangelo's

well-known

work

also

exhibitting?

N-grams

Is	Michelangelo's	well-known	work	also	exhibitting?
Is	Michelangelo's	well-known		also

Output 4

Michelangelo's

famous

work

also

display?

N-grams

Michelangelo's	famous	work	also	in	display?
Michelangelo's	famous		also		display?
Michelangelo's famous

Sentence 332) BLEU: 0 (0.4/0.25/0/0) ; 0 (0.5/0.4/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.25/0/0/0)

Source

�A

��w

��

�y��

�H

Ref 0

Which

seats

would

you

prefer?

Ref 1

What

seats

would

you

like?

Ref 2

What

seating

would

you

like?

Ref 3

Where

would

you

seated?

Ref 4

What

kind

seats

would

you

like?

Ref 5

Which

seats

would

you

like?

Ref 6

What

type

seats

you

want?

Ref 7

Which

seats

you

want

purchase?

Ref 8

What

seats

would

you

like?

Ref 9

Where

would

you

seated?

Ref 10

What

kind

seats

you

prefer?

Ref 11

Where

would

you

sit?

Ref 12

which

seats

would

you

sit?

Ref 13

What

seats

would

you

like?

Ref 14

What

kind

seats

would

you

like?

Ref 15

What

type

seats

would

you

prefer?

Output 0

you

that

seat?

N-grams

Do	you	like	that	seat?
	you	like
	you like

Output 1

you

that

seat

N-grams

do	you	like	that	seat	?
do	you	like
do you
	you like

Output 2

you

the

seats?

N-grams

Do	you	like	the	seats?
	you	like
	you like

Output 3

you

that

seat?

N-grams

Do	you	like	that	seat?
	you	like
	you like

Output 4

You

that

seat?

N-grams

You	like	that	seat?
	like

Sentence 333) BLEU: 0 (0.6667/0.2/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.6/0.25/0/0)

Source

�A

��

�o��

��

�F

��

�H

Ref 0

Have

you

got

these

books?

Ref 1

you

have

this

book?

Ref 2

you

got

this

book?

Ref 3

Got

this

book?

Ref 4

you

have

these

books?

Ref 5

you

carry

these

books?

Ref 6

you

stock

these

books?

Ref 7

you

have

these

books

available?

Ref 8

Are

you

carrying

these

books?

Ref 9

Would

you

selling

these

books?

Ref 10

you

have

these

books?

Ref 11

Would

you

happen

have

these

books?

Ref 12

was

wondering

you

had

these

books?

Ref 13

you

have

these

books?

Ref 14

you

carry

these

books?

Ref 15

Are

these

books

available

here?

Output 0

Did

you

take

these

books?

N-grams

Did	you	take	to	these	books?
	you		to	these	books?
				these books?

Output 1

you

these

books

N-grams

you	these	books	?
you	these	books
	these books

Output 2

You

get

these

books

it?

N-grams

You	get	these	books	it?
		these	books
		these books

Output 3

Did

you

take

these

books?

N-grams

Did	you	take	to	these	books?
	you		to	these	books?
				these books?

Output 4

You

have

attained

these

books?

N-grams

You	have	attained	these	books?
	have		these	books?
			these books?

Sentence 334) BLEU: 0 (0.8333/0.4/0/0) ; 0 (0.6667/0.2/0/0) ; 0.5373 (0.8333/0.6/0.5/0.3333) ; 0 (0.8333/0.4/0/0) ; 0 (0.5/0/0/0)

Source

��

�{��

�p��

��

�F

�C

Ref 0

think

the

calculation

wrong.

Ref 1

think

this

wrong.

Ref 2

think

these

numbers

are

off.

Ref 3

think

this

figured

wrong.

Ref 4

think

there's

error

the

calculation.

Ref 5

There

seems

mistake

the

calculations.

Ref 6

There

may

error

the

calculation.

Ref 7

seems

that

there's

miscalculation.

Ref 8

There

seems

miscalculation.

Ref 9

I'm

afraid

there's

mistake

the

calculation.

Ref 10

This

calculation

seems

wrong.

Ref 11

This

calculation

might

wrong.

Ref 12

This

seems

wrongly

calculated.

Ref 13

think

their

something

wrong

with

the

bill.

Ref 14

think

this

has

been

added

incorrectly.

Ref 15

think

the

bill

off.

Output 0

think

that

calculating

wrong.

N-grams

I	think	that	calculating	is	wrong.
I	think	that		is	wrong.
I think				is wrong.

Output 1

think

the

wrong

that

N-grams

i	think	the	wrong	that	.
	think	the	wrong	that
	think the

Output 2

think

the

calculation

was

wrong.

N-grams

I	think	the	calculation	was	wrong.
I	think	the	calculation		wrong.
I think		the calculation
I think the
I think the calculation
	think the
	think the calculation

Output 3

think

that

calculating

wrong.

N-grams

I	think	that	calculating	is	wrong.
I	think	that		is	wrong.
I think				is wrong.

Output 4

thought

that

the

idea

miscalculated.

N-grams

I	thought	that	the	idea	miscalculated.
I		that	the

Sentence 335) BLEU: 0.3403 (0.65/0.3158/0.2778/0.2353) ; 0 (0.4545/0.1/0/0) ; 0.2521 (0.6667/0.2727/0.2/0.1111) ; 0 (0.5/0.1538/0/0) ; 0.3403 (0.65/0.3158/0.2778/0.2353)

Source

��

�Q

��_

�F

�C

�A

��

�A

��

��q

�s

�T

�

��

�K

��

�s

��

�H

Ref 0

got

cut

off.

Can

you

connect

zero

three

four

five

eight

five

six

zero

six

again?

Ref 1

lost

the

connection.

Can

you

put

through

zero

three

four

five

eight

five

six

zero

six

again?

Ref 2

was

cut

off.

Please

connect

zero

three

four

five

eight

five

six

zero

six

again.

Ref 3

were

cut

off.

Please

put

through

zero

three

four

five

eight

five

six

zero

six

again.

Ref 4

The

line

was

cut

off.

Could

you

please

get

three

thirty-four

fifty-eight

fifty-six

oh-six

again

please?

Ref 5

call

was

disconnected.

Would

you

please

reconnect

with

zero

three

four

fifty-eight

fifty-six

six?

Ref 6

conversation

was

cut

off.

Could

you

please

put

through

three

four

five

eight

five

six

again?

Ref 7

was

disconnected.

Would

you

reconnect

zero

three

four

five

eight

five

six

zero

six?

Ref 8

lost

connection.

Please

connect

again

zero

three

four

five

eight

five

six

zero

six?

Ref 9

I've

been

cut

off.

you

mind

connecting

once

again

zero

three

four

five

eight

five

six

zero

six?

Ref 10

was

cut

off.

Please

put

call

through

zero

three

four

five

eight

five

six

zero

six

again.

Ref 11

The

line

was

cut

off.

Would

you

mind

putting

through

zero

three

four

five

eight

five

six

zero

six

again?

Ref 12

The

connection

was

broken.

Put

through

zero

three

four

five

eight

five

six

zero

six

again.

Ref 13

was

disconnected.

Could

you

re-connect

zero

three

four

five

eight

five

six

zero

six?

Ref 14

The

line

was

disconnected.

Could

you

patch

through

zero

three

four

five

eight

five

six

zero

six,

again?

Ref 15

lost

our

connection.

Could

you

connect

zero

three

four

five

eight

five

six

zero

six

one

time?

Output 0

shut

off.

You

can

put

through

the

zero

three

four

five

eight

five

salvarsans

again

for

me?

N-grams

shut

off.

You

can

put

through

the

zero

three

four

five

eight

five

salvarsans

again

for

me?

off.

put

through

the

zero

three

four

five

eight

five

again

zero three

three four

five eight

zero three three

four five

eight five

zero three three four

five eight five

three three

four five eight

three three four

three three four five

three four five

three four five eight

four five eight five

Output 1

cut

off

you

can

zero

for

again

N-grams

i	cut	off	you	can	zero	am	for	me	again	?
	cut		you		zero			me	again
								me again

Output 2

was

cut

off.

You

can

connect

zero

334585606

it?

N-grams

I	was	cut	off.	You	can	connect	to	my	zero	334585606	it?
I	was	cut	off.			connect	to	my	zero
I was		cut off.
I was cut
I was cut off.
	was cut
	was cut off.

Output 3

cut

off.

Your

ability

connects

for

again

zero

3345856

zero

N-grams

cut

off.

Your

ability

connects

for

again

zero

3345856

zero

cut

off.

again

zero

cut off.

me again

Output 4

shut

off.

You

can

put

through

the

zero

three

four

five

eight

five

salvarsans

again

for

me?

N-grams

shut

off.

You

can

put

through

the

zero

three

four

five

eight

five

salvarsans

again

for

me?

off.

put

through

the

zero

three

four

five

eight

five

again

zero three

three four

five eight

zero three three

four five

eight five

zero three three four

five eight five

three three

four five eight

three three four

three three four five

three four five

three four five eight

four five eight five

Sentence 336) BLEU: 0 (1/0.5/0.3333/0) ; 0 (0.6667/0.2/0/0) ; 0 (1/0.5/0.3333/0) ; 0 (1/0/0/0) ; 0 (1/0.5/0.3333/0)

Source

��

�O

�@

��

�ⴣ�c

�C

Ref 0

It's

green

suitcase.

Ref 1

The

suitcase

green.

Ref 2

suitcase

green.

Ref 3

Green

the

color

the

suitcase.

Ref 4

It'll

green

suitcase.

Ref 5

green

bag.

Ref 6

The

suitcase

green.

Ref 7

green

suitcase.

Ref 8

would

green

suitcase.

Ref 9

own

green

suitcase.

Ref 10

suitcase

green.

Ref 11

have

green

suitcase.

Ref 12

The

suitcase

green.

Ref 13

The

suitcase

green.

Ref 14

green

suitcase.

Ref 15

was

green

bag.

Output 0

green

suitcase.

N-grams

It	is	a	green	suitcase.
It	is	a	green	suitcase.
		a green
		a green suitcase.
			green suitcase.

Output 1

green

suitcase

N-grams

it	is	a	green	suitcase	.
	is	a	green	suitcase
		a green

Output 2

green

suitcase.

N-grams

It	is	a	green	suitcase.
It	is	a	green	suitcase.
		a green
		a green suitcase.
			green suitcase.

Output 3

suitcase

green.

N-grams

It	is	a	suitcase	of	green.
It	is	a	suitcase	of	green.

Output 4

green

suitcase.

N-grams

It	is	a	green	suitcase.
It	is	a	green	suitcase.
		a green
		a green suitcase.
			green suitcase.

Sentence 337) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0.3333/0/0)

Source

�ȹC

��

�x

�b

��

�H

Ref 0

Where's

the

tourist

information

office?

Ref 1

Where

the

tourist

information

office

located?

Ref 2

Where

can

find

the

tourist

information

office?

Ref 3

you

know

where

the

tourist

information

office

is?

Ref 4

Where

would

the

tourist

information

center

be?

Ref 5

Where

would

find

the

tourist

information

booth?

Ref 6

What's

the

location

the

tourist

info

counter?

Ref 7

Where

can

find

the

tourist

information

office?

Ref 8

Where

would

the

tourist

information

office

located?

Ref 9

Whereabouts

the

tourist

information

office?

Ref 10

Where

could

find

the

tourist

information

office?

Ref 11

Would

you

mind

telling

where

the

tourist

information

office

is?

Ref 12

Could

you

show

where

the

tourist

information

office

please?

Ref 13

Where

tourist

information?

Ref 14

Where

the

tourist

information

bureau

located?

Ref 15

Where

can

find

the

tourist

information

office.

Output 0

Traveling

information

office

in?

N-grams

Traveling	information	office	in?
	information	office
	information office

Output 1

which

question

mark

N-grams

which

question

mark

Output 2

Tourism

Units

which

question

mark?

N-grams

Tourism

Units

which

question

mark?

Output 3

Travel

question

mark

set

which?

N-grams

Travel

question

mark

set

which?

Output 4

Traveling

information

office

in?

N-grams

Traveling	information	office	in?
	information	office
	information office

Sentence 338) BLEU: 0 (0.6/0.5/0.3333/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6/0.5/0.3333/0)

Source

��

�d�i

�b

��

�H

Ref 0

Where

the

ticket

counter?

Ref 1

Where

can

find

the

ticket

counter?

Ref 2

Where

the

ticket

counter

located?

Ref 3

you

know

where

the

ticket

counter

is?

Ref 4

Where's

the

ticket

sales

stand?

Ref 5

Where

would

the

ticket

booth

be?

Ref 6

Where

buy

ticket?

Ref 7

Please

tell

where

the

ticket

counter

is.

Ref 8

Where

the

ticket

counter

located?

Ref 9

Whereabouts

the

ticket

counter?

Ref 10

Where

could

find

the

ticket

desk?

Ref 11

Would

you

mind

telling

where

the

ticket

counter

is?

Ref 12

Could

you

show

where

the

ticket

desk

please?

Ref 13

Where

the

ticket

wicket?

Ref 14

Where

are

tickets

sold?

Ref 15

Where

can

buy

tickets?

Output 0

Sells

the

ticket

counter

in?

N-grams

Sells	the	ticket	counter	in?
	the	ticket	counter
	the ticket
	the ticket counter
		ticket counter

Output 1

ticket

counter

N-grams

a	ticket	counter	?
a	ticket	counter
	ticket counter

Output 2

Such

selling

ticket

counter

where?

N-grams

Such	as	selling	a	ticket	counter	where?
			a	ticket	counter
				ticket counter

Output 3

Sell

counter

which?

N-grams

Sell	a	counter	which?
	a	counter

Output 4

Sells

the

ticket

counter

in?

N-grams

Sells	the	ticket	counter	in?
	the	ticket	counter
	the ticket
	the ticket counter
		ticket counter

Sentence 339) BLEU: 1 (1/1/1/1) ; 0 (0.4/0.25/0/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0 (0.3333/0/0/0)

Source

�A

��

��y

��

�H

Ref 0

you

speak

Japanese?

Ref 1

Can

you

speak

Japanese?

Ref 2

you

know

Japanese?

Ref 3

Are

you

able

speak

Japanese?

Ref 4

Can

you

speak

Japanese?

Ref 5

Are

you

able

speak

Japanese?

Ref 6

Can

you

communicate

Japanese?

Ref 7

Are

you

able

speak

Japanese?

Ref 8

Can

you

communicate

Japanese?

Ref 9

Can

you

speak

Japanese?

Ref 10

Can

you

speak

Japanese?

Ref 11

you

speak

any

Japanese?

Ref 12

Can

you

talk

Japanese?

Ref 13

Can

you

speak

Japanese?

Ref 14

Can

you

speak

Japanese?

Ref 15

you

understand

Japanese?

Output 0

you

speak

Japanese?

N-grams

Do	you	speak	Japanese?
Do	you	speak	Japanese?
Do you		speak Japanese?
Do you speak
Do you speak Japanese?
	you speak
	you speak Japanese?

Output 1

you

speak

japanese

N-grams

do	you	speak	japanese	?
	you	speak
	you speak

Output 2

you

speak

Japanese?

N-grams

Do	you	speak	Japanese?
Do	you	speak	Japanese?
Do you		speak Japanese?
Do you speak
Do you speak Japanese?
	you speak
	you speak Japanese?

Output 3

you

speak

Japanese?

N-grams

Do	you	speak	Japanese?
Do	you	speak	Japanese?
Do you		speak Japanese?
Do you speak
Do you speak Japanese?
	you speak
	you speak Japanese?

Output 4

You

spoke

Japanese?

N-grams

You	spoke	Japanese?
		Japanese?

Sentence 340) BLEU: 0.5984 (0.8/0.7143/0.5385/0.4167) ; 0.2595 (0.6875/0.4/0.2143/0.07692) ; 0.5984 (0.8/0.7143/0.5385/0.4167) ; 0.2921 (0.7647/0.5/0.2667/0.07143) ; 0 (0.4667/0.2143/0.07692/0)

Source

��

�o��

�۰�

�c��

��

�A

��O

�l��

�S��

�X��

�C

Ref 0

put

money

this

vending

machine,

but

stamps

came

out.

Ref 1

put

money

into

the

vending

machine,

but

stamps

came

out.

Ref 2

stamps

came

out

after

put

money

into

the

vending

machine.

Ref 3

inserted

money

into

the

machine,

but

stamps

came

out.

Ref 4

put

money

the

vending

machine,

but

didn't

give

any

stamps.

Ref 5

put

the

money

into

this

vending

machine,

but

didn't

get

any

stamps.

Ref 6

Even

though

put

money

into

the

vending

machine,

got

stamps.

Ref 7

Although

put

money

into

the

vending

machine,

didn't

get

any

stamps.

Ref 8

inserted

money

into

the

vending

machine,

yet

stamps

were

dispensed.

Ref 9

stamps

came

out

the

vending

machine,

even

though

put

money

in.

Ref 10

inserted

money

into

this

vending

machine,

but

the

stamps

didn't

come

out.

Ref 11

paid

money

into

this

vending

machine,

but

the

stamps

wouldn't

come

out.

Ref 12

accepted

the

money,

but

didn't

issue

the

stamps.

Ref 13

inserted

money

into

this

vending

machine

but

the

stamps

didn't

come

out.

Ref 14

inserted

money

into

this

vending

machine

but

didn't

give

the

stamps.

Ref 15

put

money

into

this

machine

but

didn't

give

the

stamps.

Output 0

put

the

money

the

vending

machine,

but

the

stamp

did

not

come

out.

N-grams

put

the

money

the

vending

machine,

but

the

stamp

did

not

come

out.

put

the

money

the

vending

machine,

but

come

out.

I put

the money

in the

vending machine,

but the

come out.

I put the

money in

the vending

machine, but

I put the money

in the vending

machine, but the

put the

money in the

vending machine, but

put the money

in the vending machine,

money in the vending

the vending machine,

the vending machine, but

vending machine, but the

Output 1

put

the

money

the

vending

machine

but

stamp

not

come

out

this

N-grams

put

the

money

the

vending

machine

but

stamp

not

come

out

this

put

the

money

the

vending

machine

but

come

out

this

put the

money in

the vending

put the money

in the

vending machine

the money

in the vending

money in the

money in the vending

Output 2

put

the

money

the

vending

machine,

but

the

stamp

did

not

come

out.

N-grams

put

the

money

the

vending

machine,

but

the

stamp

did

not

come

out.

put

the

money

the

vending

machine,

but

come

out.

I put

the money

in the

vending machine,

but the

come out.

I put the

money in

the vending

machine, but

I put the money

in the vending

machine, but the

put the

money in the

vending machine, but

put the money

in the vending machine,

money in the vending

the vending machine,

the vending machine, but

vending machine, but the

Output 3

put

money

this

inside

the

automatic

vending

machine,

but

the

stamp

didn't

come

out.

N-grams

put

money

this

inside

the

automatic

vending

machine,

but

the

stamp

didn't

come

out.

put

money

this

the

vending

machine,

but

the

didn't

come

out.

I put

in the

vending machine,

but the

didn't come

I put money

vending machine, but

didn't come out.

put money

vending machine, but the

come out.

machine, but

machine, but the

Output 4

this

trade

automatically

Qian

Fangdao

machine,

but

the

postage

stamp

has

not

come

out.

N-grams

this

trade

automatically

Qian

Fangdao

machine,

but

the

postage

stamp

has

not

come

out.

this

machine,

but

the

come

out.

machine, but

come out.

machine, but the

but the

Sentence 341) BLEU: 0.6687 (0.875/0.8571/0.6667/0.4) ; 0 (0.6364/0.4/0/0) ; 0.6687 (0.875/0.8571/0.6667/0.4) ; 0 (0.7778/0.5/0.1429/0) ; 0 (0.7/0.5556/0.25/0)

Source

��

�b

�U

�@

��

��f

�U��

�C

Ref 0

Please

let

off

the

corner.

Ref 1

Please

drop

off

the

corner.

Ref 2

the

corner,

please

drop

off.

Ref 3

Please

let

out

the

corner.

Ref 4

I'll

get

out

the

corner,

OK?

Ref 5

Can

please

get

out

the

corner?

Ref 6

Could

you

stop

the

corner

and

let

out,

please?

Ref 7

Would

you

drop

off

the

corner?

Ref 8

I'd

get

off

the

corner.

Ref 9

Could

dropped

off

the

corner?

Ref 10

Could

you

drop

off

the

corner?

Ref 11

Let

get

out

the

corner.

Ref 12

Would

you

mind

dropping

off

the

corner?

Ref 13

Please

stop

the

corner.

Ref 14

would

get

out

the

corner.

Ref 15

The

corner

would

fine,

thank

you.

Output 0

Let

get

off

the

intersection.

N-grams

Let	me	get	off	at	the	next	intersection.
Let	me	get	off	at	the	next
Let me		get off		at the
Let me get			off at		the next
	me get		off at the
		get off at
		get off at the
			off at the next
				at the next

Output 1

let

get

off

the

intersection

please

street

N-grams

let	me	get	off	the	next	intersection	please	in	street	.
let	me	get	off	the	next		please
let me		get off		the next
	me get

Output 2

Let

get

off

the

intersection.

N-grams

Let	me	get	off	at	the	next	intersection.
Let	me	get	off	at	the	next
Let me		get off		at the
Let me get			off at		the next
	me get		off at the
		get off at
		get off at the
			off at the next
				at the next

Output 3

Please

let

get

off

street

corner.

N-grams

Please	let	me	get	off	in	next	street	corner.
Please	let	me	get	off		next		corner.
Please let		me get
Please let me			get off
	let me

Output 4

Please

let

get

out

the

street

intersection.

N-grams

Please	let	me	get	out	in	the	next	street	intersection.
Please	let	me	get	out		the	next
Please let		me get				the next
Please let me			get out
	let me
		me get out

Sentence 342) BLEU: 0.5774 (0.8333/0.8/0.5/0.3333) ; 0 (0.6/0.25/0/0) ; 0 (0.4/0.25/0/0) ; 0.5774 (0.8333/0.8/0.5/0.3333) ; 0 (0.4/0/0/0)

Source

�A

��

�L�l

��

�H

Ref 0

you

have

paper

plates?

Ref 1

Are

there

any

paper

plates?

Ref 2

you

got

any

paper

plates?

Ref 3

Any

paper

plates?

Ref 4

you

carry

paper

plates?

Ref 5

Would

you

have

any

paper

plates?

Ref 6

Got

any

paper

plates?

Ref 7

Would

you

have

paper

plates?

Ref 8

Could

get

paper

plates?

Ref 9

Have

you

any

paper

plates?

Ref 10

Have

you

got

any

paper

plates?

Ref 11

Would

you

happen

have

any

paper

plates?

Ref 12

I'd

paper

plate

please.

Ref 13

you

have

any

disposable

plates?

Ref 14

Are

there

any

paper

plates?

Ref 15

Can

get

paper

plate?

Output 0

you

have

paper

plate

son?

N-grams

Do	you	have	paper	plate	son?
Do	you	have	paper	plate
Do you		have paper
Do you have			paper plate
Do you have paper
	you have
	you have paper

Output 1

paper

tray

you

have

N-grams

paper	tray	you	have	?
paper		you	have
		you have

Output 2

Paper

tray

you

have

it?

N-grams

Paper	tray	you	have	it?
		you	have
		you have

Output 3

you

have

paper

plate

son?

N-grams

Do	you	have	paper	plate	son?
Do	you	have	paper	plate
Do you		have paper
Do you have			paper plate
Do you have paper
	you have
	you have paper

Output 4

You

have

the

paper

tray?

N-grams

You	have	the	paper	tray?
	have		paper

Sentence 343) BLEU: 0 (0.5714/0.1667/0/0) ; 0 (0.7143/0/0/0) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.625/0.2857/0/0) ; 0 (0.5/0.2/0/0)

Source

�A

�X��

��

�ت�

�O

��

�H

Ref 0

What's

the

purpose

your

visit?

Ref 1

What's

the

purpose

your

stay?

Ref 2

For

what

reason

are

you

visiting?

Ref 3

What

the

reason

for

your

visit?

Ref 4

What

brings

you

here?

Ref 5

What

the

reason

for

your

visit?

Ref 6

What

your

reason

for

visiting?

Ref 7

Why

are

you

visiting?

Ref 8

What

the

reason

for

your

visit?

Ref 9

Please

state

the

purpose

your

visit.

Ref 10

Why

are

you

visiting

here?

Ref 11

What's

the

reason

for

your

visit?

Ref 12

Please

tell

why

you

are

visiting

here.

Ref 13

Why

are

you

visiting?

Ref 14

What

the

reason

for

your

visit?

Ref 15

For

what

reason

did

you

come?

Output 0

You

visit

the

what

the

purpose?

N-grams

You	visit	the	what	is	the	purpose?
		the	what	is
				is the

Output 1

you

visit

the

what

purpose

N-grams

you	visit	the	what	is	purpose	?
you		the	what	is	purpose

Output 2

You

visit

the

What

the

purpose?

N-grams

You	visit	the	What	is	the	purpose?
		the	What	is
			What is
			What is the
				is the

Output 3

You

visit

what

the

purpose

N-grams

You	visit	of	what	is	the	purpose	?
		of	what	is	the	purpose
				is the
					the purpose

Output 4

You

visit

what

the

goal?

N-grams

You	visit	what	is	the	goal?
		what	is	the
			is the

Sentence 344) BLEU: 1 (1/1/1/1) ; 0 (0.2/0/0/0) ; 0 (0.75/0.3333/0/0) ; 1 (1/1/1/1) ; 0 (0.6/0/0/0)

Source

��

�i�H

��

�b

�o��

��

�H

Ref 0

May

sit

here?

Ref 1

Can

sit

here?

Ref 2

you

mind

sit

here?

Ref 3

alright

sit

here?

Ref 4

sit

here?

Ref 5

this

seat

taken?

Ref 6

Mind

have

seat?

Ref 7

you

mind

sit

here?

Ref 8

Would

alright

for

sit

here?

Ref 9

Could

sit

here?

Ref 10

you

mind

sit

here?

Ref 11

Would

okay

for

sit

here?

Ref 12

alright

for

sit

here?

Ref 13

May

take

seat

here?

Ref 14

May

seated

here?

Ref 15

alright

sit

here?

Output 0

Can

sit

here?

N-grams

Can	I	sit	here?
Can	I	sit	here?
Can I		sit here?
Can I sit
Can I sit here?
	I sit
	I sit here?

Output 1

can

sit

here

N-grams

i	can	sit	here	?
		sit

Output 2

can

sit

here?

N-grams

I	can	sit	here?
I		sit	here?
		sit here?

Output 3

Can

sit

here?

N-grams

Can	I	sit	here?
Can	I	sit	here?
Can I		sit here?
Can I sit
Can I sit here?
	I sit
	I sit here?

Output 4

may

sit

here?

N-grams

I	may	sit	in	here?
I		sit		here?

Sentence 345) BLEU: 0 (0.5714/0.1667/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.5714/0/0/0) ; 0 (0.5714/0.1667/0/0) ; 0 (0.375/0.1429/0/0)

Source

�A

��

�M

�ڭ�

�@�_

�\

��

�H

Ref 0

Would

you

pose

with

us?

Ref 1

Would

you

the

picture

with

me?

Ref 2

you

want

get

the

picture

with

me?

Ref 3

Please

get

the

picture

with

me.

Ref 4

Would

you

mind

taking

picture

with

us?

Ref 5

Would

you

take

picture

with

us,

please?

Ref 6

Would

you

our

picture,

please?

Ref 7

Can

take

picture

together?

Ref 8

you

mind

taking

picture

with

us?

Ref 9

How

about

taking

picture

together?

Ref 10

you

want

get

the

photo?

Ref 11

Would

you

join

photo?

Ref 12

How

about

posing

photo

with

us?

Ref 13

Would

you

have

your

picture

taken

with

us?

Ref 14

Would

you

mind

having

your

photo

taken

with

us?

Ref 15

Would

you

join

our

picture?

Output 0

Can

you

put

posture

together

with

us?

N-grams

Can	you	put	posture	together	with	us?
Can	you				with	us?
					with us?

Output 1

together

with

you

can

posture

N-grams

together	with	us	you	can	posture	?
	with	us	you

Output 2

Together

with

you

can

pose

it?

N-grams

Together	with	us	you	can	pose	it?
	with	us	you		pose

Output 3

Can

you

put

posture

together

with

us?

N-grams

Can	you	put	posture	together	with	us?
Can	you				with	us?
					with us?

Output 4

You

can

assume

the

posture

together

with

us?

N-grams

You	can	assume	the	posture	together	with	us?
			the			with	us?
						with us?

Sentence 346) BLEU: 1 (1/1/1/1) ; 0.4347 (0.7143/0.5/0.4/0.25) ; 1 (1/1/1/1) ; 0.6435 (0.8571/0.6667/0.6/0.5) ; 0 (0.6667/0.2/0/0)

Source

�A

��

��{��

��

�H

Ref 0

you

have

return

ticket?

Ref 1

you

have

ticket

back?

Ref 2

you

have

round-trip

ticket?

Ref 3

Have

you

purchased

return

ticket?

Ref 4

you

own

return

ticket?

Ref 5

Did

you

bring

return

ticket?

Ref 6

What

about

return

ticket?

Ref 7

you

possess

return

ticket?

Ref 8

Are

you

holding

return

ticket?

Ref 9

Have

you

return

ticket?

Ref 10

Have

you

got

return

flight

ticket?

Ref 11

Have

you

got

ticket

for

your

return

flight?

Ref 12

Would

you

happen

have

return

ticket?

Ref 13

you

have

ticket

home?

Ref 14

you

have

ticket

for

the

return

flight?

Ref 15

you

have

ticket

for

your

return

journey?

Output 0

you

have

return

ticket?

N-grams

Do	you	have	a	return	ticket?
Do	you	have	a	return	ticket?
Do you		have a		return ticket?
Do you have			a return
Do you have a
	you have		a return ticket?
	you have a
	you have a return
		have a return
		have a return ticket?

Output 1

you

have

return

ticket

N-grams

do	you	have	a	return	ticket	?
	you	have	a	return	ticket
	you have		a return
	you have a
	you have a return
		have a
		have a return

Output 2

you

have

return

ticket?

N-grams

Do	you	have	a	return	ticket?
Do	you	have	a	return	ticket?
Do you		have a		return ticket?
Do you have			a return
Do you have a
	you have		a return ticket?
	you have a
	you have a return
		have a return
		have a return ticket?

Output 3

you

have

return

journey

ticket?

N-grams

Do	you	have	a	return	journey	ticket?
Do	you	have	a	return		ticket?
Do you		have a
Do you have			a return
Do you have a
	you have
	you have a
	you have a return
		have a return

Output 4

You

have

the

return

trip

ticket?

N-grams

You	have	the	return	trip	ticket?
	have	the	return		ticket?
		the return

Sentence 347) BLEU: 0 (0.6/0.2857/0.07692/0) ; 0 (0.125/0/0/0) ; 0 (0.7/0.2222/0.125/0) ; 0 (0.6/0.2857/0.07692/0) ; 0 (0.6667/0.25/0/0)

Source

��

�C

��

�n��

�P�_

�F

�C

��

�Q

��

�C

Ref 0

Hi.

seem

have

cold.

I'd

see

Dr.

Johnson.

Ref 1

Hello.

looks

have

come

down

with

cold.

Can

see

Dr.

Johnson?

Ref 2

Hi.

think

I've

got

cold.

Can

Dr.

Johnson

see

me?

Ref 3

Hello.

appears

that

I've

caught

cold.

I'd

have

Dr.

Johnson

take

look

me.

Ref 4

Good

afternoon.

seems

I've

caught

cold.

I'm

hoping

see

Dr.

Johnson.

Ref 5

Hello.

seems

that

I've

got

cold.

need

see

Dr.

Johnson,

could.

Ref 6

Afternoon.

appear

have

caught

cold.

I'm

here

see

Dr.

Johnson,

may.

Ref 7

Hello.

looks

I've

caught

cold.

I'm

hoping

see

Dr.

Johnson.

Ref 8

Hi.

seems

that

I've

caught

cold.

Would

able

see

Dr.

Johnson?

Ref 9

Hi.

I'm

afraid

have

cold.

Could

make

appointment

with

Dr.

Johnson?

Ref 10

Hello.

think

I've

caught

cold.

I'd

Dr.

Johnson

see

me.

Ref 11

Good

afternoon.

might

have

cold.

want

see

Dr.

Johnson.

Ref 12

Good

evening.

feel

I've

got

cold.

May

see

Dr.

Johnson?

Ref 13

Hello.

seem

have

caught

cold.

would

examined

Dr.

Johnson.

Ref 14

Good

afternoon.

seem

have

come

down

with

cold.

was

wondering

Dr.

Johnson

could

see

me.

Ref 15

Hello.

seem

come

down

with

case

the

sniffles.

Could

Dr.

Johnson

see

me?

Output 0

Hi.

seemed

catch

cold.

wish

see

John

lousy

doctor.

N-grams

Hi.

seemed

catch

cold.

wish

see

John

lousy

doctor.

Hi.

cold.

see

Hi. I

a cold.

to see

a cold. I

cold. I

Output 1

cold

doctor

johnson

N-grams

i	a	cold	i	doctor	johnson	hi	.
	a

Output 2

嗨.

cold.

imagine

that

Doctor

Johnson.

N-grams

嗨.	I	like	a	cold.	I	imagine	that	Doctor	Johnson.
	I	like	a	cold.	I		that		Johnson.
			a cold.
			a cold. I
				cold. I

Output 3

Hi.

seemed

catch

cold.

wish

see

John

lousy

doctor.

N-grams

Hi.

seemed

catch

cold.

wish

see

John

lousy

doctor.

Hi.

cold.

see

Hi. I

a cold.

to see

a cold. I

cold. I

Output 4

Hi.

caught

cold

probably.

infer

Dr.

Johnson.

N-grams

Hi.	I	caught	cold	probably.	I	infer	Dr.	Johnson.
Hi.	I	caught			I		Dr.	Johnson.
Hi. I							Dr. Johnson.

Sentence 348) BLEU: 0.4948 (0.8571/0.6154/0.4167/0.2727) ; 0 (0.5/0.1111/0/0) ; 0.4948 (0.8571/0.6154/0.4167/0.2727) ; 0 (0.4167/0.09091/0/0) ; 0 (0.5385/0.25/0.09091/0)

Source

�o

�O

��

�O

��

�A

��

�ئ�

��

�Q

�K

�@��

�C

Ref 0

This

the

Tower

Babel

and

it's

from

the

eighteenth

century.

Ref 1

This

called

the

Tower

Babel.

was

made

the

eighteenth

century.

Ref 2

This

the

Tower

Babel.

was

completed

the

eighteenth

century.

Ref 3

This

the

Tower

Babel.

dates

from

the

eighteenth

century.

Ref 4

Here's

the

Tower

Babel.

It's

eighteenth

century

work.

Ref 5

This

right

here

the

Tower

Babel.

was

built

the

eighteenth

century.

Ref 6

Here

have

the

Tower

Babel.

dates

back

the

eighteenth

century.

Ref 7

This

would

the

Tower

Babel.

dates

the

eighteenth

century.

Ref 8

Located

here

the

Tower

Babel.

originates

the

eighteenth

century.

Ref 9

This

the

famous

Tower

Babel.

goes

back

the

eighteenth

century.

Ref 10

Here

the

Tower

Babel.

dates

from

the

eighteenth

century.

Ref 11

The

Tower

Babel

here,

and

eighteenth

century

work.

Ref 12

Here

lies

the

Tower

Babel

which

originates

from

the

eighteenth

century.

Ref 13

This

the

Tower

Babel.

It's

artifact

from

the

eighteenth

century.

Ref 14

It's

the

Tower

Babel.

dates

back

the

eighteenth

century.

Ref 15

Here

the

Tower

Babel.

eighteenth

century

monument.

Output 0

This

the

castle

Tower

babel,

which

was

built

the

eighteenth

century.

N-grams

This

the

castle

Tower

babel,

which

was

built

the

eighteenth

century.

This

the

Tower

which

was

built

the

eighteenth

century.

This is

Tower of

was built

in the

eighteenth century.

This is the

was built in

the eighteenth

is the

was built in the

built in

the eighteenth century.

built in the

built in the eighteenth

in the eighteenth

in the eighteenth century.

Output 1

this

the

castle

tower

century

N-grams

this	is	the	castle	tower	,	in	century	it	.
	is	the				in	century	it
	is the

Output 2

This

the

Castle

Tower

Babel,

which

was

built

the

eighteenth

century.

N-grams

This

the

Castle

Tower

Babel,

which

was

built

the

eighteenth

century.

This

the

Tower

which

was

built

the

eighteenth

century.

This is

Tower of

was built

in the

eighteenth century.

This is the

was built in

the eighteenth

is the

was built in the

built in

the eighteenth century.

built in the

built in the eighteenth

in the eighteenth

in the eighteenth century.

Output 3

This

don't

tower

fortress,

builds

18th

century.

N-grams

This	is	Ba	don't	tower	fortress,	it	builds	up	in	18th	century.
This	is					it			in		century.
This is

Output 4

This

the

Palestinian

other

tower

castle,

completed

ten

8th

century.

N-grams

This

the

Palestinian

other

tower

castle,

completed

ten

8th

century.

This

the

completed

century.

This is

completed in

This is the

is the

Sentence 349) BLEU: 0 (0.2/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0/0/0/0)

Source

��

�O

�覡

��

�H

Ref 0

Western?

Ref 1

that

Western?

Ref 2

that

movie

Western?

Ref 3

cowboy

show?

Ref 4

about

the

wild

West?

Ref 5

about

cowboys

and

Indians?

Ref 6

that

considered

Western?

Ref 7

Would

you

say

that's

Western?

Ref 8

Would

that

Western?

Ref 9

this

Western

film?

Ref 10

this

set

the

wild

west?

Ref 11

cowboy

film?

Ref 12

that

Western

Style

play?

Ref 13

that

cowboy

play?

Ref 14

that

play

about

the

old

wild

west?

Ref 15

Western?

Output 0

Western-style

it?

N-grams

It	is	a	Western-style	it?
		a

Output 1

western-style

N-grams

it	is	western-style	?
it

Output 2

Western-style

it?

N-grams

It	is	a	Western-style	it?
		a

Output 3

western?

N-grams

Is	it	western?
Is	it
Is it

Output 4

western-style?

N-grams

western-style?

Sentence 350) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.5/0.1429/0/0)

Source

��Q�l�s

�M

��

�~

�O

�K�O

��

�H

Ref 0

the

gin

and

tonic

free?

Ref 1

the

gin

and

tonic

available

charge?

Ref 2

Can

have

the

gin

and

tonic

for

free?

Ref 3

there

charge

for

the

gin

and

tonic?

Ref 4

there

charge

for

the

gin

tonic?

Ref 5

the

gin

tonic

complementary?

Ref 6

the

gin

and

tonic

charge?

Ref 7

free

for

gin

and

tonic?

Ref 8

you

charge

for

gin

and

tonic?

Ref 9

Would

gin

and

tonic

cost

anything?

Ref 10

have

pay

for

this

gin

and

tonic?

Ref 11

the

gin

and

tonic

the

house?

Ref 12

gin

and

tonic

free

charge?

Ref 13

have

pay

for

gin

and

tonic?

Ref 14

Are

gin

and

tonics

gratuitous?

Ref 15

the

gin

and

tonic

free?

Output 0

Gin

and

tonic

are

free?

N-grams

Gin	and	tonic	are	free?
	and	tonic		free?
	and tonic

Output 1

gin

and

are

free

the

N-grams

gin	and	are	free	the	?
gin	and		free	the
gin and

Output 2

Gin

and

tonic

are

free?

N-grams

Gin	and	tonic	are	free?
	and	tonic		free?
	and tonic

Output 3

Gin

and

nourishing

the

article

free?

N-grams

Gin	and	nourishing	is	the	article	free?
	and			the		free?

Output 4

The

gin

and

the

food

supplement

are

free?

N-grams

The	gin	and	the	food	supplement	are	free?
	gin	and	the				free?
	gin and

Sentence 351) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.3333/0/0/0) ; 0 (1/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.8/0.5/0.3333/0)

Source

��

�N

��

�ɭ�

��

�H

Ref 0

What

time

will

over?

Ref 1

What

time

will

end?

Ref 2

What

time

does

end?

Ref 3

When

will

end?

Ref 4

What

time

does

end?

Ref 5

When

will

finish?

Ref 6

When

does

finish

up?

Ref 7

What

time

does

end?

Ref 8

When

will

over?

Ref 9

When's

going

end?

Ref 10

What

time

does

end?

Ref 11

what

time

will

finish?

Ref 12

When

will

end?

Ref 13

What

time

will

finish?

Ref 14

what

time

will

conclude?

Ref 15

what

time

does

end?

Output 0

When

will

finish?

N-grams

When	will	it	in	finish?
When	will	it		finish?
When will
When will it
	will it

Output 1

when

will

end

N-grams

when	it	will	end	in	?
	it	will

Output 2

When

will

end?

N-grams

When	it	will	end?
When	it	will	end?

Output 3

will

when

end?

N-grams

It	will	in	when	end?
	will			end?

Output 4

When

will

finish?

N-grams

When	will	it	in	finish?
When	will	it		finish?
When will
When will it
	will it

Sentence 352) BLEU: 0 (0.4/0/0/0) ; 0 (0.4444/0.25/0.1429/0) ; 0 (0.5/0.2222/0/0) ; 0 (0.4/0/0/0) ; 0 (0.4167/0.09091/0/0)

Source

��

�C

�p�G

�ڭ�

�q

�o��

��f

��s

�

��

�

��

�I

�H

Ref 0

Hey.

Wouldn't

quicker

turned

this

corner?

Ref 1

Hey.

turned

here

the

corner

wouldn't

quicker?

Ref 2

Hey.

Wouldn't

quicker

turned

here

this

corner?

Ref 3

Hey.

Don't

you

think

would

quicker

turned

this

corner?

Ref 4

Yo.

Isn't

closer

make

turn

this

corner?

Ref 5

Say.

Won't

faster

turn

this

corner?

Ref 6

Hey.

Won't

get

there

faster

turning

this

corner?

Ref 7

Say.

Isn't

closer

you

turn

this

corner?

Ref 8

Oh.

Wouldn't

turning

this

corner

faster?

Ref 9

Um.

think

that

turning

this

corner

would

closer.

Ref 10

Hang

on.

Isn't

faster

turn

this

corner?

Ref 11

Hold

on.

think

it's

closer

turn

the

corner

here.

Ref 12

Wait

moment.

I'm

sure

it's

nearer

make

turn

this

corner.

Ref 13

Oh.

Isn't

closer

turn

down

this

corner?

Ref 14

Oh.

Wouldn't

closer

turned

here?

Ref 15

Oh.

Isn't

better

turn

this

corner?

Output 0

Hi.

can

hurry

from

this

street

corner

turn?

N-grams

Hi.	If	can	we	hurry	from	this	street	corner	turn?
	If		we			this		corner

Output 1

turn

from

this

can

street

N-grams

if	we	turn	from	this	hi	can	street	?
if	we	turn		this
if we
if we turn
	we turn

Output 2

嗨.

turn

from

this

junction

will

soon?

N-grams

嗨.	If	we	turn	from	this	junction	will	be	soon?
	If	we	turn		this			be
	If we
		we turn

Output 3

Hi.

can

hurry

from

this

street

corner

turn?

N-grams

Hi.	If	can	we	hurry	from	this	street	corner	turn?
	If		we			this		corner

Output 4

Hi.

from

this

street

intersection

curve

can

bit

faster?

N-grams

Hi.	If	we	from	this	street	intersection	curve	can	a	bit	faster?
	If	we		this					a		faster?
	If we

Sentence 353) BLEU: 0 (0.6667/0.5/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.6667/0.5/0/0)

Source

饻�j��]

�b

��

�H

Ref 0

Where

the

Japanese

Embassy?

Ref 1

Where

the

Japanese

Embassy

located?

Ref 2

Where

can

find

the

Japanese

Embassy?

Ref 3

you

know

where

the

Japanese

Embassy

is?

Ref 4

Where

would

the

Japanese

Embassy

be?

Ref 5

Where

the

Japanese

Embassy

located?

Ref 6

Where

would

find

the

Japanese

embassy?

Ref 7

Where

the

Japanese

Embassy

located?

Ref 8

Could

you

tell

where

the

Japanese

Embassy

is?

Ref 9

Whereabouts

the

Japanese

Embassy?

Ref 10

Could

you

tell

where

the

Japanese

Embassy

is?

Ref 11

Where

could

find

the

Japanese

Embassy?

Ref 12

The

Japanese

Embassy,

please.

Ref 13

Where

can

find

the

Japanese

Embassy?

Ref 14

Where

the

Japanese

Embassy

located?

Ref 15

Where

the

Embassy

Japan

located?

Output 0

Japanese

Embassy

in?

N-grams

Japanese	Embassy	in?
Japanese	Embassy
Japanese Embassy

Output 1

japanese

embassy

N-grams

japanese

embassy

Output 2

Japanese

embassy

what?

N-grams

Japanese	embassy	in	what?
Japanese

Output 3

Japanese

embassy

which?

N-grams

Japanese	embassy	at	which?
Japanese

Output 4

Japanese

Embassy

in?

N-grams

Japanese	Embassy	in?
Japanese	Embassy
Japanese Embassy

Sentence 354) BLEU: 0 (0.5/0.2727/0.1/0) ; 0 (0.2/0/0/0) ; 0 (0.5/0.2727/0.1/0) ; 0 (0.25/0/0/0) ; 0 (0.625/0.2857/0/0)

Source

��

�o

��

��Z

�w�g

�q

��

�F

�C

Ref 0

I'm

afraid

this

flight

booked

solid.

Ref 1

I'm

sorry

say

that

this

flight

booked

solid.

Ref 2

This

flight

booked

solid,

I'm

sorry

say.

Ref 3

hate

say

it,

but

this

flight

full.

Ref 4

Unfortunately,

there

room

this

flight.

Ref 5

I'm

sorry

tell

you,

but

this

flight

completely

full.

Ref 6

hate

tell

you,

but

this

flight

all

booked

up.

Ref 7

Unfortunately

this

flight

full.

Ref 8

I'm

sorry

but

this

flight

sold

out.

Ref 9

I'm

afraid

there

are

seats

available

this

flight.

Ref 10

I'm

sorry

but

this

flight

full.

Ref 11

Sorry,

but

there

are

seats

left

for

this

flight.

Ref 12

Unfortunately,

this

flight

fully

booked.

Ref 13

afraid

this

flight

full.

Ref 14

sorry

but

this

flight

does

not

have

any

available

seats.

Ref 15

sorry

but

this

flight

all

booked.

Output 0

afraid

the

purpose

his

flights

have

been

fully

booked.

N-grams

I	am	afraid	the	purpose	of	his	flights	have	been	fully	booked.
I	am	afraid						have		fully	booked.
I am										fully booked.
I am afraid
	am afraid

Output 1

this

already

full

N-grams

of	this	already	full	.
	this

Output 2

afraid

the

purpose

his

flights

have

been

fully

booked.

N-grams

I	am	afraid	the	purpose	of	his	flights	have	been	fully	booked.
I	am	afraid						have		fully	booked.
I am										fully booked.
I am afraid
	am afraid

Output 3

Afraiding

this

service

has

already

ordered

full.

N-grams

Afraiding	of	this	service	has	already	ordered	full.
		this					full.

Output 4

Feared

this

flight

already

full.

N-grams

Feared	this	flight	already	to	subscribe	is	full.
	this	flight		to		is	full.
	this flight					is full.

Sentence 355) BLEU: 0 (0.6/0.3333/0.125/0) ; 0 (0.5/0.2857/0/0) ; 0 (0.6/0.3333/0.125/0) ; 0.2907 (0.6/0.3333/0.25/0.1429) ; 0 (0.6667/0.2727/0.1/0)

Source

��

�Q

�n

��

�@��

�䥦

��

�˦�

��

�C

Ref 0

I'd

see

some

others

different

design.

Ref 1

I'd

see

some

different

designs.

Ref 2

Please

show

some

different

designs.

Ref 3

I'd

see

some

other

designs.

Ref 4

I'd

interested

looking

some

other

ones

with

different

design.

Ref 5

wonder

could

see

some

with

different

design.

Ref 6

interested

having

look

something

that

has

different

design.

Ref 7

Could

see

something

alternate

design?

Ref 8

Would

you

have

something

you

could

show

different

design?

Ref 9

want

see

something

different

design.

Ref 10

would

see

some

which

are

designed

differently.

Ref 11

you

have

others

with

different

designs?

Ref 12

Could

you

please

show

some

different

designs?

Ref 13

would

see

others

that

are

different

design.

Ref 14

would

see

other

things

that

have

different

design.

Ref 15

would

view

others

that

don't

have

the

same

design.

Output 0

want

watch

some

other

not

have

style.

N-grams

I	want	to	watch	some	other	do	not	have	style.
I	want	to		some	other			have
I want				some other
I want to
	want to

Output 1

want

some

other

not

style

N-grams

i	want	to	some	other	not	style	.
	want	to	some	other
	want to		some other

Output 2

want

watch

some

other

not

have

style.

N-grams

I	want	to	watch	some	other	do	not	have	style.
I	want	to		some	other			have
I want				some other
I want to
	want to

Output 3

want

see

not

using

some

otherses

style.

N-grams

I	want	to	see	not	using	of	some	otherses	style.
I	want	to	see			of	some
I want		to see
I want to
I want to see
	want to
	want to see

Output 4

want

look

that

some

other

does

not

use

the

style.

N-grams

I	want	to	look	that	some	other	does	not	use	the	style.
I	want	to	look	that	some	other				the
I want					some other
I want to
	want to

Sentence 356) BLEU: 0 (0.4286/0/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.2857/0.1667/0/0)

Source

��

�]

��

�ۦW

�H

Ref 0

What's

famous

for?

Ref 1

What

known

for?

Ref 2

What

this

famous

for?

Ref 3

What

famous

about

this?

Ref 4

Why

famous?

Ref 5

What

makes

famous?

Ref 6

How

come

it's

famous?

Ref 7

Why

famous?

Ref 8

How

did

get

famous?

Ref 9

What's

the

reason

for

its

fame?

Ref 10

Why

famous?

Ref 11

What

makes

famous?

Ref 12

Why

such

famous

place?

Ref 13

Why

that

famous?

Ref 14

For

what

reason

that

famous?

Ref 15

Why

well

known?

Output 0

well

known

because

what?

N-grams

It	is	well	known	because	of	what?
	is	well	known

Output 1

because

what

N-grams

it	is	because	of	what	?
it	is			what
it is

Output 2

well

known

because

what?

N-grams

It	is	well	known	because	of	what?
	is	well	known

Output 3

because

what

and

well-known?

N-grams

It	because	of	what	and	well-known?
			what

Output 4

because

what,

but

famous?

N-grams

It	because	of	what,	but	is	famous?
					is	famous?
					is famous?

Sentence 357) BLEU: 0.4347 (0.7143/0.5/0.4/0.25) ; 0 (0.4/0.25/0/0) ; 0.4347 (0.7143/0.5/0.4/0.25) ; 0 (0.5/0.2/0/0) ; 0 (0.5714/0.1667/0/0)

Source

��

�@��

��

�b

��

�a��

�F

�C

Ref 0

left

passport

somewhere.

Ref 1

lost

passport

somewhere.

Ref 2

left

passport

laying

around

somewhere.

Ref 3

forgot

passport

somewhere.

Ref 4

forgot

passport

somewhere.

Ref 5

forgot

and

left

passport

somewhere.

Ref 6

I've

forgotten

and

left

passport

behind

somewhere.

Ref 7

I've

forgotten

passport

somewhere.

Ref 8

misplaced

passport.

Ref 9

can't

remember

where

left

passport.

Ref 10

forgot

passport

some

place.

Ref 11

I've

misplaced

passport.

Ref 12

I've

mislaid

passport.

Ref 13

forgot

passport

someplace.

Ref 14

lost

passport

somewhere.

Ref 15

have

put

down

and

forgotten

passport

somewhere.

Output 0

lost

passport

what

place.

N-grams

I	lost	my	passport	what	a	place.
I	lost	my	passport			place.
I lost		my passport
I lost my
I lost my passport
	lost my
	lost my passport

Output 1

passport

place

N-grams

i	my	passport	place	.
	my	passport
	my passport

Output 2

lost

passport

what

place.

N-grams

I	lost	my	passport	what	a	place.
I	lost	my	passport			place.
I lost		my passport
I lost my
I lost my passport
	lost my
	lost my passport

Output 3

cast

away

passport

where.

N-grams

I	cast	away	my	passport	where.
I			my	passport
			my passport

Output 4

threw

mine

passport

any

place.

N-grams

I	threw	mine	passport	in	any	place.
I			passport	in		place.
			passport in

Sentence 358) BLEU: 0.3352 (0.8333/0.4545/0.3/0.1111) ; 0.4671 (0.6667/0.5/0.4286/0.3333) ; 0.7506 (0.8889/0.75/0.7143/0.6667) ; 0.3352 (0.8333/0.4545/0.3/0.1111) ; 0 (0.5/0.3333/0.125/0)

Source

��

�i

��

��F

��

�g�ٿ�

��

�C

Ref 0

Two

economy

class

tickets

Los

Angeles,

please.

Ref 1

would

two

economy

class

tickets

Los

Angeles,

please.

Ref 2

Please

give

two

economy

class

tickets

Los

Angeles.

Ref 3

want

two

economy

class

tickets

for

Los

Angeles,

please.

Ref 4

I'd

tickets

for

two

us,

economy

class,

for

please.

Ref 5

Two

coach

seat

tickets

LA,

please.

Ref 6

I'd

get

two

coach

seats

for

LA,

please.

Ref 7

I'd

two

economy

class

tickets

Los

Angeles,

please.

Ref 8

May

have

two

economy

class

tickets

Los

Angeles,

please?

Ref 9

Could

get

two

economy

class

tickets

Los

Angeles,

please?

Ref 10

I'd

book

economy

class

flight

for

two

Los

Angeles.

Ref 11

Could

buy

two

economy

class

tickets

Los

Angeles?

Ref 12

want

book

two

economy

class

seats

for

Los

Angeles.

Ref 13

Two

economy

class

Los

Angeles,

please.

Ref 14

would

two

economy

class

tickets

for

Los

Angeles,

please.

Ref 15

would

two

tickets

Los

Angeles,

economy

class,

please.

Output 0

Please

come

two

economy

class

tickets

that

get

Los

Angeles.

N-grams

Please	come	to	two	economy	class	tickets	that	get	to	Los	Angeles.
Please		to	two	economy	class	tickets		get	to	Los	Angeles.
			two economy		class tickets				to Los
			two economy class						to Los Angeles.
			two economy class tickets							Los Angeles.
				economy class
				economy class tickets

Output 1

two

economy

class

tickets

los

angeles

N-grams

to	two	economy	class	tickets	to	los	angeles	.
to	two	economy	class	tickets	to
	two economy		class tickets
	two economy class			tickets to
	two economy class tickets
		economy class
		economy class tickets
		economy class tickets to
			class tickets to

Output 2

Invited

two

economy

class

tickets

Los

Angeles.

N-grams

Invited	to	two	economy	class	tickets	to	Los	Angeles.
	to	two	economy	class	tickets	to	Los	Angeles.
		two economy		class tickets		to Los
		two economy class			tickets to		Los Angeles.
		two economy class tickets				to Los Angeles.
			economy class		tickets to Los
			economy class tickets
			economy class tickets to
				class tickets to
				class tickets to Los
					tickets to Los Angeles.

Output 3

Please

come

two

economy

class

tickets

that

get

Los

Angeles.

N-grams

Please	come	to	two	economy	class	tickets	that	get	to	Los	Angeles.
Please		to	two	economy	class	tickets		get	to	Los	Angeles.
			two economy		class tickets				to Los
			two economy class						to Los Angeles.
			two economy class tickets							Los Angeles.
				economy class
				economy class tickets

Output 4

Invites

two

Los

Angeles's

economy

class

cabin

airplane

ticket.

N-grams

Invites	two	to	Los	Angeles's	economy	class	cabin	airplane	ticket.
	two	to	Los		economy	class
	two to				economy class
	two to Los
		to Los

Sentence 359) BLEU: 0 (0.7143/0.1667/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.6/0.25/0/0) ; 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.5714/0/0/0)

Source

��

�餸

�ʪ�

��

�H

Ref 0

Can

shopping

with

Japanese

yen?

Ref 1

Can

buy

things

with

Japanese

yen?

Ref 2

alright

shop

with

yen?

Ref 3

Can

use

yen

shopping?

Ref 4

Can

use

yen

when

shopping?

Ref 5

Can

buy

things

shop

with

yen?

Ref 6

Can

use

yen

when

shopping?

Ref 7

Can

pay

for

items

yen?

Ref 8

you

payment

yen?

Ref 9

Can

shop

yen?

Ref 10

Can

shop

Japanese

yen?

Ref 11

shops

Japanese

yen?

Ref 12

Would

able

buy

things

using

Japanese

yen?

Ref 13

May

purchase

things

with

Japanese

yen?

Ref 14

Can

shop

using

Japanese

yen?

Ref 15

Japanese

yen

accepted

the

shops?

Output 0

can

use

Japanese

yen

shopping?

N-grams

I	can	use	a	Japanese	yen	shopping?
I		use		Japanese	yen	shopping?
				Japanese yen

Output 1

japanese

yen

can

use

shopping

N-grams

japanese	yen	can	i	use	shopping	?
	yen			use	shopping

Output 2

Japanese

Yen

Can

shop?

N-grams

Japanese	Yen	Can	I	shop?
Japanese		Can	I
		Can I

Output 3

Can

use

yen

shopping?

N-grams

Can	I	use	yen	shopping?
Can	I	use	yen	shopping?
Can I		use yen
Can I use
Can I use yen
	I use
	I use yen

Output 4

can

use

Japanese

Yen

shopping?

N-grams

I	can	use	a	Japanese	Yen	shopping?
I		use		Japanese		shopping?

Sentence 360) BLEU: 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0)

Source

�o��

�C

Ref 0

Here.

Ref 1

Look.

Ref 2

Hey.

Ref 3

Look

here.

Ref 4

Look.

Ref 5

Hey,

take

look.

Ref 6

Listen.

Ref 7

Over

here.

Ref 8

See,

here.

Ref 9

Right

here.

Ref 10

There

you

go.

Ref 11

Look.

Ref 12

Here

is.

Ref 13

There.

Ref 14

See.

Ref 15

Voila.

Output 0

Here.

N-grams

Here.

Output 1

here

N-grams

here

Output 2

這裡.

N-grams

這裡.

Output 3

Here.

N-grams

Here.

Output 4

Here.

N-grams

Here.

Sentence 361) BLEU: 0 (0.4/0.25/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0)

Source

��n

�A

�h

�F

�A

��

�C

Ref 0

more,

thanks.

Ref 1

more,

thank

you.

Ref 2

thanks.

Ref 3

No,

that's

all.

Ref 4

I'm

good,

thanks.

Ref 5

thanks,

I'm

fine.

Ref 6

thank

you,

I'm

good.

Ref 7

Not

anymore,

thanks.

Ref 8

That's

plenty,

thanks.

Ref 9

I've

had

enough,

thanks.

Ref 10

thanks,

I'm

fine.

Ref 11

I'm

okay,

thanks.

Ref 12

No,

thank

you.

Ref 13

No,

I'm

fine

thank

you.

Ref 14

I'm

done,

thank

you.

Ref 15

That's

all,

thank

you.

Output 0

Let

stop,

thank

you.

N-grams

Let	us	stop,	thank	you.
			thank	you.
			thank you.

Output 1

thank

many

again

N-grams

,	thank	be	many	again	.
	thank

Output 2

Let

stop,

thank

you.

N-grams

Let	us	stop,	thank	you.
			thank	you.
			thank you.

Output 3

Don't

wanted

many

again,

thank.

N-grams

Don't

wanted

many

again,

thank.

Output 4

Should

not

again

many,

thanks.

N-grams

Should	not	be	again	many,	thanks.
					thanks.

Sentence 362) BLEU: 0 (0.75/0.2857/0/0) ; 0 (0.6/0.3333/0.125/0) ; 0 (0.75/0.2857/0/0) ; 0 (0.625/0.1429/0/0) ; 0 (0.4444/0/0/0)

Source

�{�b

��

�~�[

��

�y��

�H

Ref 0

Which

shows

are

popular

right

now?

Ref 1

Which

the

shows

are

popular

right

now.

Ref 2

What

shows

are

popular

right

now?

Ref 3

Right

now,

what

shows

are

popular?

Ref 4

What's

playing

that's

popular

now?

Ref 5

What's

currently

playing

that's

hot?

Ref 6

What

shows

are

that

everybody

wants

see

right

now?

Ref 7

What

shows

are

currently

booming

popularity?

Ref 8

What

are

the

latest

popular

shows?

Ref 9

Can

you

tell

which

shows

are

the

rage

now?

Ref 10

Which

are

the

popular

attractions

the

moment?

Ref 11

What

are

the

most

popular

shows

these

days?

Ref 12

Which

are

the

most

visited

shows

now?

Ref 13

Currently,

which

ones

are

popular?

Ref 14

Which

presentations

are

popular

the

moment?

Ref 15

Which

shows

are

popular

these

days?

Output 0

Now

that

the

appearance

the

most

popular?

N-grams

Now	that	the	appearance	of	the	most	popular?
	that	the		of	the	most	popular?
				of the
					the most

Output 1

now

that

the

appearance

the

most

popular

N-grams

now	that	the	appearance	of	the	most	popular	is	?
	that	the		of	the	most	popular
				of the		most popular
					the most
					the most popular

Output 2

Now

that

the

appearance

the

most

popular?

N-grams

Now	that	the	appearance	of	the	most	popular?
	that	the		of	the	most	popular?
				of the
					the most

Output 3

Now

that

the

appearance

the

most

popular?

N-grams

Now	that	is	the	appearance	the	most	popular?
	that		the		the	most	popular?
					the most

Output 4

Now

that

kind

outward

appearance

most

popular?

N-grams

Now	that	kind	of	outward	appearance	is	most	popular?
	that		of				most	popular?

Sentence 363) BLEU: 0 (1/0.5/0.3333/0) ; 0 (0.8333/0.4/0.25/0) ; 0 (1/0.5/0.3333/0) ; 0 (1/0.5/0.3333/0) ; 0 (0.6667/0.2/0/0)

Source

]

��

�@

��

�pô

��X

�C

Ref 0

Also

ask

for

contact

number.

Ref 1

Remember

ask

for

contact

number,

too.

Ref 2

Ask

for

contact

number,

too.

Ref 3

Don't

forget

ask

for

contact

number,

too.

Ref 4

Please

get

contact

number

well.

Ref 5

Please

ask

for

contact

information

well.

Ref 6

Also,

please

find

out

the

contact

information.

Ref 7

Please

also

ask

for

contact.

Ref 8

Could

you

also

get

contact

number?

Ref 9

You

should

also

ask

for

contact

number.

Ref 10

Please

ask

for

contact

details

too.

Ref 11

Request

contact

information

well.

Ref 12

Ask

for

telephone

number

too.

Ref 13

Please

also

get

contact

number.

Ref 14

Please

also

get

the

contact

information.

Ref 15

Please

get

the

contact

information

well.

Output 0

Also

find

contact

number.

N-grams

Also	find	a	contact	number.
Also	find	a	contact	number.
		a contact
		a contact number.
			contact number.

Output 1

also

find

contact

number

N-grams

also	find	a	contact	number	.
also	find	a	contact	number
		a contact
		a contact number
			contact number

Output 2

Also

find

contact

number.

N-grams

Also	find	a	contact	number.
Also	find	a	contact	number.
		a contact
		a contact number.
			contact number.

Output 3

Also

find

contact

number.

N-grams

Also	find	a	contact	number.
Also	find	a	contact	number.
		a contact
		a contact number.
			contact number.

Output 4

Also

looks

for

relation

number.

N-grams

Also	looks	for	a	relation	number.
Also		for	a		number.
		for a

Sentence 364) BLEU: 0 (0.625/0.2857/0/0) ; 0 (0.375/0/0/0) ; 0 (1/0.6/0.25/0) ; 0 (0.625/0.2857/0/0) ; 0 (0.3333/0/0/0)

Source

��

�Ө�

�o��

�C

Ref 0

I'm

happy

came

here.

Ref 1

I'm

glad

that

came

here.

Ref 2

I'm

happy

that

decided

come

here.

Ref 3

Coming

here

was

great

decision.

Ref 4

I'm

delighted

that

came

here.

Ref 5

I'm

thrilled

have

come

here.

Ref 6

I'm

really

happy

have

come

here.

Ref 7

I'm

really

glad

that

came

here.

Ref 8

Happy

here.

Ref 9

It's

joy

here.

Ref 10

I'm

happy

here.

Ref 11

makes

happy

here.

Ref 12

It's

wonderful

here.

Ref 13

glad

came.

Ref 14

glad

have

come

here.

Ref 15

glad

that

made

here.

Output 0

very

happy

arrive

here.

N-grams

I	am	very	happy	to	arrive	at	here.
I	am		happy	to			here.
I am			happy to

Output 1

here

very

arrive

N-grams

i	am	to	here	very	arrive	at	.
	am	to	here

Output 2

delighted

here.

N-grams

I	am	delighted	to	be	here.
I	am	delighted	to	be	here.
I am			to be
			to be here.
				be here.

Output 3

very

happy

arrive

here.

N-grams

I	am	very	happy	to	arrive	at	here.
I	am		happy	to			here.
I am			happy to

Output 4

arrive

here

very

happily.

N-grams

I	arrive	at	here	very	happily.
I			here

Sentence 365) BLEU: 0 (0.4/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.2/0/0/0)

Source

�o��

�ж�

�O��

�h��

�H

Ref 0

How

much

the

room

charge?

Ref 1

How

much

the

room?

Ref 2

How

much

does

the

room

cost?

Ref 3

How

much

for

the

room?

Ref 4

How

much

you

charge

for

room?

Ref 5

What's

the

room

charge?

Ref 6

How

much

are

your

rooms?

Ref 7

How

much

will

the

room

cost?

Ref 8

What's

the

cost

for

the

room?

Ref 9

How

much

will

for

the

room?

Ref 10

What

does

the

room

cost?

Ref 11

What

the

room

rental

fee?

Ref 12

How

much

for

the

room?

Ref 13

How

much

does

cost

for

the

room?

Ref 14

How

much

does

the

room

cost?

Ref 15

How

much

you

charge

for

the

room?

Output 0

The

cost

this

room?

N-grams

The	cost	of	this	room?
	cost			room?

Output 1

this

room

how

N-grams

this	room	how	?
	room

Output 2

The

cost

this

room?

N-grams

The	cost	of	this	room?
	cost			room?

Output 3

How

much

this

room

expenses?

N-grams

How	much	is	this	room	expenses?
How	much	is		room
How much
How much is
	much is

Output 4

This

room

expense

how

many?

N-grams

This	room	expense	how	many?
	room

Sentence 366) BLEU: 0 (0.5/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (1/1/0/0)

Source

�

�A

�S��

�C

Ref 0

No,

nothing.

Ref 1

No,

not

thing.

Ref 2

No,

nothing

all.

Ref 3

No,

don't

have

anything.

Ref 4

No,

not

thing.

Ref 5

No,

not

all.

Ref 6

No,

don't

have

anything.

Ref 7

No,

there's

nothing.

Ref 8

No,

don't.

Ref 9

have

nothing

declare.

Ref 10

No,

I've

got

nothing.

Ref 11

don't

have

anything

declare.

Ref 12

No,

don't

have

anything.

Ref 13

No,

don't.

Ref 14

No,

nothing

declare.

Ref 15

No,

nothing.

Output 0

No,

no.

N-grams

No,	no.
No,

Output 1

nothing

N-grams

no	,	nothing	.
		nothing

Output 2

No,

no.

N-grams

No,	no.
No,

Output 3

Not,

nothing.

N-grams

Not,	nothing.
	nothing.

Output 4

No,

nothing.

N-grams

No,	nothing.
No,	nothing.
No, nothing.

Sentence 367) BLEU: 0.5373 (0.8333/0.6/0.5/0.3333) ; 0 (0.7143/0.1667/0/0) ; 0 (0.75/0/0/0) ; 0.5373 (0.8333/0.6/0.5/0.3333) ; 0.3826 (0.75/0.4286/0.3333/0.2)

Source

�A��

��

�ɭ�

��

�y��

�H

Ref 0

When

you

have

seats

available?

Ref 1

When

would

the

seats

available?

Ref 2

When

you

think

you'll

have

seats

available?

Ref 3

When

will

the

seats

available?

Ref 4

When

will

you

have

seat

availability?

Ref 5

When

will

you

have

some

openings

for

seats?

Ref 6

When

will

you

have

some

seats?

Ref 7

For

when

are

there

seats

available?

Ref 8

For

what

times

you

have

seats

that

aren't

taken?

Ref 9

When

are

there

seats

available?

Ref 10

When

you

have

availabilities?

Ref 11

For

when

can

get

seat?

Ref 12

When

are

there

available

seats?

Ref 13

When

will

seats

become

available?

Ref 14

When

can

get

seat?

Ref 15

When

can

get

seats?

Output 0

When

you

have

empty

seat?

N-grams

When	do	you	have	empty	seat?
When	do	you	have		seat?
When do		you have
When do you
When do you have
	do you
	do you have

Output 1

when

you

empty

have

seat

N-grams

when	you	empty	do	have	seat	?
when	you		do	have	seat
				have seat

Output 2

When

you

empty

seats?

N-grams

When	you	empty	seats?
When	you		seats?

Output 3

When

you

have

empty

seat?

N-grams

When	do	you	have	empty	seat?
When	do	you	have		seat?
When do		you have
When do you
When do you have
	do you
	do you have

Output 4

When

you

have

free

time

the

seat?

N-grams

When	do	you	have	free	time	the	seat?
When	do	you	have			the	seat?
When do		you have
When do you
When do you have
	do you
	do you have

Sentence 368) BLEU: 0 (0.6667/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6667/0/0/0)

Source

��

�s

�C

Ref 0

Change,

please.

Ref 1

Please

change

this

for

me.

Ref 2

Exchange

this,

please.

Ref 3

Please

exchange

this.

Ref 4

Could

get

some

change,

please?

Ref 5

May

have

some

change,

please?

Ref 6

Could

you

give

some

change,

please?

Ref 7

I'd

this

exchanged,

please.

Ref 8

Would

you

exchange

this,

please?

Ref 9

May

exchange,

please?

Ref 10

Could

you

exchange

this

for

me?

Ref 11

I'd

have

this

converted.

Ref 12

want

you

exchange

this.

Ref 13

would

change,

please.

Ref 14

Could

you

break

this

for

me,

please.

Ref 15

Could

you

change

this

into

something

smaller,

please?

Output 0

Please

give

change.

N-grams

Please	give	change.
Please	give

Output 1

please

give

change

N-grams

please	give	change	.
	give	change

Output 2

Please

give

change.

N-grams

Please	give	change.
Please	give

Output 3

Please

return

change.

N-grams

Please	return	change.
Please

Output 4

Please

give

change.

N-grams

Please	give	change.
Please	give

Sentence 369) BLEU: 0 (0.5556/0.25/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.5556/0.25/0/0) ; 0 (0.1429/0/0/0) ; 0 (0.375/0.1429/0/0)

Source

��S��

�A

��

��n

��

�Ʊ�

�H

Ref 0

there

anything

you

can

quickly?

Ref 1

there

anything

you

can

serve

quickly?

Ref 2

there

anything

that

can

served

quickly?

Ref 3

you

have

anything

that

can

served

quickly?

Ref 4

there

anything

that

can

done

right

away?

Ref 5

there

anything

that

can

done

quickly?

Ref 6

there

anything

possible

right

away?

Ref 7

What

can

you

quickly?

Ref 8

What

are

you

especially

fast

doing?

Ref 9

you

have

something

that

you

are

really

quick

doing?

Ref 10

Can

you

anything

quickly?

Ref 11

What

can

you

quickly?

Ref 12

you

have

good

speed

something?

Ref 13

you

have

anything

that's

fast?

Ref 14

you

have

anything

that

can

cooked

fast?

Ref 15

you

have

anything

that's

quick?

Output 0

Have

not

you

can

quickly

good

thing?

N-grams

Have	not	you	can	quickly	do	a	good	thing?
		you	can		do	a	good
		you can				a good

Output 1

have

you

can

quickly

thing

very

N-grams

have	you	can	quickly	thing	very	?
have	you	can
	you can

Output 2

Have

not

you

can

quickly

good

thing?

N-grams

Have	not	you	can	quickly	do	a	good	thing?
		you	can		do	a	good
		you can				a good

Output 3

Have

your

ability

very

fast

made-up

thing?

N-grams

Have	your	ability	very	fast	made-up	thing?
				fast

Output 4

Has

matter

which

you

can

complete

very

quickly?

N-grams

Has	matter	which	you	can	complete	very	quickly?
			you	can			quickly?
			you can

Sentence 370) BLEU: 0 (0.8333/0.4/0.25/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.8333/0.4/0.25/0) ; 0 (0.8333/0.4/0.25/0) ; 0 (0.8333/0.4/0.25/0)

Source

��

�C

Ref 0

can't

find

baggage.

Ref 1

can't

find

luggage.

Ref 2

luggage

missing.

Ref 3

don't

see

luggage.

Ref 4

I'm

not

seeing

bags.

Ref 5

can't

locate

luggage.

Ref 6

I'm

unable

locate

bags.

Ref 7

luggage

where

found.

Ref 8

I'm

not

seeing

bags

anywhere.

Ref 9

I've

lost

luggage.

Ref 10

hand-luggage

has

gone

missing.

Ref 11

bag

lost.

Ref 12

can't

seem

find

the

whereabouts

luggage.

Ref 13

can't

seem

find

luggage.

Ref 14

don't

see

luggage

anywhere.

Ref 15

can't

find

baggage.

Output 0

can

not

find

luggage.

N-grams

I	can	not	find	my	luggage.
I		not	find	my	luggage.
			find my
			find my luggage.
				my luggage.

Output 1

not

find

could

baggage

N-grams

i	not	find	my	could	baggage	.
	not	find	my
		find my

Output 2

can

not

find

luggage.

N-grams

I	can	not	find	my	luggage.
I		not	find	my	luggage.
			find my
			find my luggage.
				my luggage.

Output 3

could

not

find

baggage.

N-grams

I	could	not	find	my	baggage.
I		not	find	my	baggage.
			find my
			find my baggage.
				my baggage.

Output 4

could

not

find

baggage.

N-grams

I	could	not	find	my	baggage.
I		not	find	my	baggage.
			find my
			find my baggage.
				my baggage.

Sentence 371) BLEU: 1 (1/1/1/1) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 1 (1/1/1/1) ; 0.7953 (1/0.8/0.75/0.6667) ; 0.5373 (0.8333/0.6/0.5/0.3333)

Source

��

�Q

��

�C

Ref 0

I'd

play

golf.

Ref 1

want

play

golf.

Ref 2

Golf

what

want

play.

Ref 3

I'd

play

some

golf.

Ref 4

I'd

love

play

golf.

Ref 5

want

play

golf.

Ref 6

I'm

hoping

play

golf.

Ref 7

I'm

hoping

play

some

golf.

Ref 8

want

play

game

golf.

Ref 9

feel

playing

golf.

Ref 10

want

play

golf.

Ref 11

want

golfing.

Ref 12

I'd

game

golf.

Ref 13

want

play

golf

Ref 14

would

play

some

golf.

Ref 15

would

golf.

Output 0

want

play

golf.

N-grams

I	want	to	play	golf.
I	want	to	play	golf.
I want		to play
I want to			play golf.
I want to play
	want to
	want to play
	want to play golf.
		to play golf.

Output 1

want

play

golf

N-grams

i	want	to	play	golf	.
	want	to	play	golf
	want to		play golf
	want to play
	want to play golf
		to play
		to play golf

Output 2

want

play

golf.

N-grams

I	want	to	play	golf.
I	want	to	play	golf.
I want		to play
I want to			play golf.
I want to play
	want to
	want to play
	want to play golf.
		to play golf.

Output 3

want

play

golf.

N-grams

I	want	to	play	a	golf.
I	want	to	play	a	golf.
I want		to play
I want to			play a
I want to play
	want to
	want to play
	want to play a
		to play a

Output 4

want

play

the

golf.

N-grams

I	want	to	play	the	golf.
I	want	to	play		golf.
I want		to play
I want to
I want to play
	want to
	want to play

Sentence 372) BLEU: 0 (1/0/0/0) ; 0 (0.5/0/0/0) ; 0 (1/0/0/0) ; 0 (0.75/0/0/0) ; 0 (0.6667/0.5/0/0)

Source

�ݭn

��U

��

�H

Ref 0

Need

hand?

Ref 1

Can

help

you

out?

Ref 2

Can

lend

you

hand?

Ref 3

Shall

give

you

hand?

Ref 4

Can

give

you

hand?

Ref 5

Could

you

use

hand?

Ref 6

Lend

you

hand?

Ref 7

Can

help

you?

Ref 8

Could

lend

hand?

Ref 9

Would

you

hand?

Ref 10

Can

help

you?

Ref 11

there

anything

can

help?

Ref 12

Could

lend

hand?

Ref 13

May

assist

you?

Ref 14

Can

help

you?

Ref 15

May

some

assistance?

Output 0

Need

help?

N-grams

Need	help?
Need	help?

Output 1

need

help

N-grams

need	help	to	?
	help	to

Output 2

Need

help?

N-grams

Need	help?
Need	help?

Output 3

Need

helped?

N-grams

Need	to	be	helped?
Need	to	be

Output 4

Needs

help?

N-grams

Needs	to	help?
	to	help?
	to help?

Sentence 373) BLEU: 0 (0.8/0.3158/0.1111/0) ; 0 (0.4545/0.04762/0/0) ; 0 (0.8/0.3158/0.1111/0) ; 0.207 (0.5652/0.2273/0.1429/0.1) ; 0 (0.5556/0.2353/0.0625/0)

Source

�n

�A

�c

�@

�A

�G

�A

�T

�A

�G

�Q

��

�w��

�A

�c

�A

�@

��

��Q��

��

�w��

�M

��

�w��

�C

��

�A

��

�F

�C

Ref 0

Well,

uh.

One,

two,

three

twenty

cent

coins

and

uh,

one

fifty

cent

coin

and

two

five

cent

coins.

Ah,

have

it.

Ref 1

Well,

uh.

There

are

one,

two,

three

twenty

cent

coins,

one

fifty

cent

coin,

and

two

five

cent

coins.

OK,

I've

got

it.

Ref 2

Well,

let's

see.

One,

two,

three

the

twenty

cent

coins,

one

the

fifty

cent

coins,

and

two

the

five

cent

coins.

Yep,

I've

got

it.

Ref 3

Well,

let

see.

One,

two,

three

twenty

cent

coins,

fifty

cent

coin,

and

couple

five

cent

coins.

Ah,

got

it.

Ref 4

Um,

let

see.

There's

one,

two,

three

the

twenty-cent

coins

and

then

fifty-cent

piece,

and

two

the

five-cent

coins.

OK,

I've

got

it.

Ref 5

OK,

um,

let's

see.

One,

two,

three

the

twenty-centers,

fifty-center,

and

two

the

five

centers.

Yeah,

it's

all

there.

Ref 6

Ah,

hmm.

Here's

one,

two,

three

the

twenty-cent

coins,

and

then

here's

fifty-cent

coin,

and

two

five-cent

ones.

Yep,

that's

it.

Ref 7

Let

see.

One,

two,

three

twenty

cent

coins

and

then,

one

fifty

cent

coin

and

two

five

cent

coins.

Yes,

it's

here.

Ref 8

Okay,

let's

see.

One,

two,

three

twenty

cent

coins

and,

one

fifty

cents

and

two

five

cents.

Here

is.

Ref 9

Hmm,

one

second.

One,

two,

three

twenty

cent

pieces

and,

one

fifty

cent

piece

and

two

nickels.

I've

got

it.

Ref 10

Let

think.

Um.

One,

two,

three

twenty

cent

coins

and

uh,

one

fifty

cent

coin

and

two

five

cent

coins.

yes,

I've

got

it.

Ref 11

Let

see

now.

Um.

One,

two,

three

twenty

cent

coins

and

uh,

one

fifty

cent

coin

and

two

five

cent

coins.

Ah,

here

is.

Ref 12

Well

now.

Um.

One,

two,

three

twenty

cent

coins

and

uh,

one

fifty

cent

coin

and

two

five

cent

coins.

Good,

found

it.

Ref 13

Uh,

well.

Twenty

cent

coin,

one,

two,

three.

And

then

fifty

cent

coin

and

then

two

five

cent

coins.

Yes,

it's

there.

Ref 14

Let's

see.

Twenty

cent

coin,

one,

two,

three.

And

then

fifty

cent

coin

and

then

two

five

cent

coins.

Yes,

I've

got

it.

Ref 15

Hmm.

Let's

see.

Twenty

cent

coin,

one,

two,

three.

And

then

fifty

cent

coin

and

then

two

five

cent

coins.

Yes,

there

is.

Output 0

Well,

uh,

one,

two,

three,

two

very

coins,

uh,

great

five

coins

and

two

five

coins.

Ah,

have.

N-grams

Well,

uh,

one,

two,

three,

two

very

coins,

uh,

great

five

coins

and

two

five

coins.

Ah,

have.

Well,

uh,

one,

two,

two

coins,

five

coins

and

two five

coins.

Ah,

one, two,

coins and

coins. Ah,

and two

coins. Ah, I

and two five

Ah, I

Output 1

one

two

three

two

coins

five

coins

and

coin

had

N-grams

one

two

three

two

coins

five

coins

and

coin

had

one

two

three

coins

five

coins and

coin

and

Output 2

Well,

uh,

one,

two,

three,

two

very

coins,

uh,

great

five

coins

and

two

five

coins.

Ah,

have.

N-grams

Well,

uh,

one,

two,

three,

two

very

coins,

uh,

great

five

coins

and

two

five

coins.

Ah,

have.

Well,

uh,

one,

two,

two

coins,

five

coins

and

two five

coins.

Ah,

one, two,

coins and

coins. Ah,

and two

coins. Ah, I

and two five

Ah, I

Output 3

Like,

two,

three,

cent

coin,

one

coin

cents

and

two

five

cent

coin.

had.

N-grams

Like,

two,

three,

cent

coin,

one

coin

cents

and

two

five

cent

coin.

had.

two,

cent

coin,

one

coin

cents

and

two

five

cent

cent coin,

cents and

two five

cents and two

five cent

cents and two five

and two

and two five

and two five cent

two five cent

Output 4

Good,

one,

two,

three,

point

coin,

point

coins

and

two

five

point

coins.

had.

N-grams

Good,

one,

two,

three,

point

coin,

point

coins

and

two

five

point

coins.

had.

Good,

one,

two,

coin,

coins

and

two

five

coins.

one, two,

coins and

two five

and two

and two five

Sentence 374) BLEU: 0 (0.5/0.3333/0/0) ; 0.4111 (0.5714/0.5/0.4/0.25) ; 0.6148 (0.7143/0.6667/0.6/0.5) ; 1 (1/1/1/1) ; 0 (0.5/0.3333/0/0)

Source

��

�Q

�n

�@

��

�B�ʾc

�C

Ref 0

I'd

pair

sneakers.

Ref 1

I'd

some

sneakers.

Ref 2

pair

sneakers,

please.

Ref 3

Sneakers,

please.

Ref 4

want

pair

sneakers.

Ref 5

need

pair

sneakers.

Ref 6

I'm

hoping

find

pair

sneakers.

Ref 7

want

pair

sneakers.

Ref 8

I'm

looking

for

some

runners.

Ref 9

I'd

get

some

runners.

Ref 10

want

some

sneakers.

Ref 11

want

buy

some

sneakers.

Ref 12

I'd

buy

sneakers.

Ref 13

looking

for

pair

sneakers.

Ref 14

would

some

sneakers.

Ref 15

want

pair

runners.

Output 0

want

athletic

shoes.

N-grams

I	want	athletic	shoes.
I	want
I want

Output 1

want

pair

shoes

N-grams

i	want	a	pair	of	shoes	.
	want	a	pair	of
	want a		pair of
	want a pair
	want a pair of
		a pair
		a pair of

Output 2

want

pair

sports

shoes.

N-grams

I	want	a	pair	of	sports	shoes.
I	want	a	pair	of
I want		a pair
I want a			pair of
I want a pair
	want a
	want a pair
	want a pair of
		a pair of

Output 3

want

pair

sneakers.

N-grams

I	want	a	pair	of	sneakers.
I	want	a	pair	of	sneakers.
I want		a pair		of sneakers.
I want a			pair of
I want a pair
	want a		pair of sneakers.
	want a pair
	want a pair of
		a pair of
		a pair of sneakers.

Output 4

want

athletic

shoes.

N-grams

I	want	athletic	shoes.
I	want
I want

Sentence 375) BLEU: 0 (0.875/0.5714/0.3333/0) ; 0 (0.5714/0.1667/0/0) ; 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.875/0.5714/0.3333/0) ; 0 (0.6667/0.375/0.1429/0)

Source

��

�a

��

�h

��

�C

Ref 0

Please

take

hospital.

Ref 1

Could

you

take

the

hospital?

Ref 2

Please

get

hospital.

Ref 3

Please

give

ride

the

hospital

Ref 4

Please

escort

hospital.

Ref 5

Please

get

hospital.

Ref 6

Please

help

get

hospital.

Ref 7

Would

you

take

the

hospital?

Ref 8

Could

you

bring

the

hospital?

Ref 9

I'd

taken

the

hospital.

Ref 10

Drive

the

hospital.

Ref 11

The

hospital,

please.

Ref 12

Would

you

mind

taking

the

hospital.

Ref 13

Please

get

hospital.

Ref 14

Please

escort

hospital.

Ref 15

Please

get

the

hospital.

Output 0

Please

bring

hospital.

N-grams

Please	bring	me	to	go	to	a	hospital.
Please	bring	me	to		to	a	hospital.
	bring me				to a
	bring me to				to a hospital.
		me to				a hospital.

Output 1

please

hospital

N-grams

please	me	to	hospital	go	to	.
	me	to	hospital		to
	me to

Output 2

Please

take

hospital.

N-grams

Please	take	me	to	hospital.
Please	take	me	to	hospital.
Please take		me to
Please take me
Please take me to
	take me
	take me to

Output 3

Please

bring

hospital.

N-grams

Please	bring	me	to	go	to	a	hospital.
Please	bring	me	to		to	a	hospital.
	bring me				to a
	bring me to				to a hospital.
		me to				a hospital.

Output 4

Invites

lead

the

hospital.

N-grams

Invites	to	lead	me	to	go	to	the	hospital.
	to		me	to		to the		hospital.
			me to			to the hospital.
							the
							the hospital.

Sentence 376) BLEU: 0.4154 (1/0.625/0.2857/0.1667) ; 0 (0.7143/0.1667/0/0) ; 0 (1/0.5/0/0) ; 0.3689 (0.7778/0.5/0.2857/0.1667) ; 0 (1/0.5/0.3333/0)

Source

��

�b

�q�l

�u�{

�t

�C

Ref 0

I'm

the

Electronic

Engineering

Department.

Ref 1

I'm

part

the

Electronic

Engineering

Department.

Ref 2

The

Electronic

Engineering

Department

mine.

Ref 3

department

the

Electronic

Engineering

one.

Ref 4

I'm

the

Electronic

Engineering

Section.

Ref 5

work

the

Electronic

Engineering

Department.

Ref 6

department

Electronic

Engineering.

Ref 7

I'm

the

Department

Electrical

Engineering.

Ref 8

I'm

Electrical

Engineering

student.

Ref 9

I'm

Electrical

Engineering.

Ref 10

belong

the

Electronics

Department.

Ref 11

based

the

Electronics

Department.

Ref 12

I'm

from

Electronics.

Ref 13

the

electronic

engineering

department.

Ref 14

the

electronic

engineering

section.

Ref 15

belong

the

electronic

engineering

division.

Output 0

the

department

the

Electronics

Engineering.

N-grams

I	am	in	the	department	of	the	Electronics	Engineering.
I	am	in	the	department	of	the Electronics		Engineering.
I am		in the			of the		Electronics
I am in
I am in the
	am in
	am in the

Output 1

department

electronic

engineering

N-grams

i	department	of	electronic	engineering	in	.
	department	of	electronic	engineering	in
			electronic engineering

Output 2

Department

Electronic

Engineering.

N-grams

I	Department	of	Electronic	Engineering.
I	Department	of	Electronic	Engineering.
	Department of		Electronic Engineering.

Output 3

the

department

the

electronics

engineering.

N-grams

I	am	in	the	department	of	the	electronics	engineering.
I	am	in	the	department	of
I am		in the			of the
I am in
I am in the
	am in
	am in the

Output 4

electronic

engineering

department.

N-grams

I	in	electronic	engineering	department.
I	in	electronic	engineering	department.
		electronic engineering
		electronic engineering department.
			engineering department.

Sentence 377) BLEU: 1 (1/1/1/1) ; 0 (0.8333/0.6/0.25/0) ; 1 (1/1/1/1) ; 0 (1/0.6/0.25/0) ; 1 (1/1/1/1)

Source

�o

�O

��

�ʶR

��ĳ

�C

Ref 0

Here

purchase

agreement.

Ref 1

This

proof

purchase.

Ref 2

Here

proof

purchase.

Ref 3

proof

purchase

this.

Ref 4

This

purchase

agreement.

Ref 5

This

the

purchase

document.

Ref 6

The

purchase

agreement

this

one.

Ref 7

This

would

purchase

agreement.

Ref 8

Here's

copy

purchase

agreement.

Ref 9

This

the

purchase

agreement.

Ref 10

This

purchase

agreement.

Ref 11

Please

purchase

agreement.

Ref 12

I'd

give

you

purchase

agreement.

Ref 13

Here

the

purchaser's

copy

the

agreement.

Ref 14

Here

the

buyer's

copy

the

purchase

documents.

Ref 15

This

copy

the

purchase

agreement.

Output 0

This

purchase

agreement.

N-grams

This	is	my	purchase	agreement.
This	is	my	purchase	agreement.
This is		my purchase
This is my			purchase agreement.
This is my purchase
	is my
	is my purchase
	is my purchase agreement.
		my purchase agreement.

Output 1

this

purchase

agreement

N-grams

this	is	my	purchase	agreement	.
this	is	my	purchase	agreement
	is my		purchase agreement
	is my purchase
		my purchase

Output 2

This

purchase

agreement.

N-grams

This	is	my	purchase	agreement.
This	is	my	purchase	agreement.
This is		my purchase
This is my			purchase agreement.
This is my purchase
	is my
	is my purchase
	is my purchase agreement.
		my purchase agreement.

Output 3

This

purchase

agreement.

N-grams

This	is	my	to	purchase	agreement.
This	is	my	to	purchase	agreement.
This is				purchase agreement.
This is my
	is my

Output 4

This

purchase

agreement.

N-grams

This	is	my	purchase	agreement.
This	is	my	purchase	agreement.
This is		my purchase
This is my			purchase agreement.
This is my purchase
	is my
	is my purchase
	is my purchase agreement.
		my purchase agreement.

Sentence 378) BLEU: 0 (0.75/0.4286/0.1667/0) ; 0 (0.5714/0.1667/0/0) ; 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.75/0.4286/0.1667/0) ; 0 (0.6667/0.375/0.1429/0)

Source

��

�a

��

�h

��

�C

Ref 0

Please

take

hospital.

Ref 1

Could

you

take

the

hospital?

Ref 2

Please

get

hospital.

Ref 3

Please

give

ride

the

hospital.

Ref 4

Please

get

hospital.

Ref 5

Can

you

please

take

the

hospital?

Ref 6

Could

you

help

get

hospital,

please.

Ref 7

Would

you

escort

the

hospital?

Ref 8

Can

taken

the

hospital?

Ref 9

want

taken

the

hospital,

please.

Ref 10

Drive

the

hospital.

Ref 11

The

hospital,

please.

Ref 12

Would

you

mind

taking

the

hospital.

Ref 13

Please

get

the

hospital.

Ref 14

Please

escort

the

hospital.

Ref 15

Please

help

the

hospital.

Output 0

Please

bring

hospital.

N-grams

Please	bring	me	to	go	to	a	hospital.
Please		me	to		to	a	hospital.
		me to			to a
					to a hospital.
						a hospital.

Output 1

please

hospital

N-grams

please	me	to	hospital	go	to	.
please	me	to			to
	me to

Output 2

Please

take

hospital.

N-grams

Please	take	me	to	hospital.
Please	take	me	to	hospital.
Please take		me to
Please take me
Please take me to
	take me
	take me to

Output 3

Please

bring

hospital.

N-grams

Please	bring	me	to	go	to	a	hospital.
Please		me	to		to	a	hospital.
		me to			to a
					to a hospital.
						a hospital.

Output 4

Invites

lead

the

hospital.

N-grams

Invites	to	lead	me	to	go	to	the	hospital.
	to		me	to		to the		hospital.
			me to			to the hospital.
							the
							the hospital.

Sentence 379) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��

�C

Ref 0

Hey.

Ref 1

Hey

you.

Ref 2

Over

here.

Ref 3

Look

here.

Ref 4

Yo.

Ref 5

Hey,

you.

Ref 6

Hey

there.

Ref 7

Excuse

me.

Ref 8

Pardon

me.

Ref 9

Hey,

you.

Ref 10

You

there.

Ref 11

there.

Ref 12

Hello

there.

Ref 13

Hello.

Ref 14

Hey

you.

Ref 15

Yoo

hoo.

Output 0

Hi.

N-grams

Hi.

Output 1

N-grams

Output 2

嗨.

N-grams

嗨.

Output 3

Hi.

N-grams

Hi.

Output 4

Hi.

N-grams

Hi.

Sentence 380) BLEU: 0.6043 (1/0.8/0.5/0.3333) ; 0 (0.8/0.25/0/0) ; 0 (1/0.6667/0.5/0) ; 0 (0.75/0.3333/0/0) ; 0.6043 (1/0.8/0.5/0.3333)

Source

�A

��

�y�U

��

�_��

�~

�F

�C

Ref 0

Your

cheek

looks

swollen.

Ref 1

Your

cheeks

look

they

are

swollen.

Ref 2

Your

cheeks

seem

swollen

up.

Ref 3

looks

your

cheek

swollen.

Ref 4

Your

cheek

looks

puffy.

Ref 5

Your

cheek

seems

swelled

up.

Ref 6

looks

you

have

swollen

cheek.

Ref 7

think

that

your

cheek

might

swollen.

Ref 8

You

might

have

swollen

cheek

there.

Ref 9

Your

cheek

seems

swollen.

Ref 10

There

might

some

swelling

your

cheek.

Ref 11

think

your

cheek

may

swollen.

Ref 12

Your

cheek

looks

puffy.

Ref 13

Your

cheek

appears

inflamed.

Ref 14

Your

cheeks

seems

bit

puffed

up.

Ref 15

Your

cheek

looks

swollen.

Output 0

Your

cheeks

look

are

swollen.

N-grams

Your	cheeks	look	like	are	swollen.
Your	cheeks	look	like	are	swollen.
Your cheeks		look like		are swollen.
Your cheeks look
Your cheeks look like
	cheeks look
	cheeks look like

Output 1

your

cheeks

look

swollen

N-grams

your	cheeks	look	swollen	.
your	cheeks	look	swollen
	cheeks look

Output 2

Your

cheeks

look

swollen.

N-grams

Your	cheeks	look	swollen.
Your	cheeks	look	swollen.
Your cheeks
Your cheeks look
	cheeks look

Output 3

Your

cheeks

looked

swollen.

N-grams

Your	cheeks	looked	swollen.
Your	cheeks		swollen.
Your cheeks

Output 4

Your

cheeks

look

are

swollen.

N-grams

Your	cheeks	look	like	are	swollen.
Your	cheeks	look	like	are	swollen.
Your cheeks		look like		are swollen.
Your cheeks look
Your cheeks look like
	cheeks look
	cheeks look like

Sentence 381) BLEU: 0 (0.625/0.2857/0.1667/0) ; 0 (0.3636/0.1/0/0) ; 0 (0.7143/0.3333/0.2/0) ; 0 (0.375/0/0/0) ; 0 (0.625/0.2857/0.1667/0)

Source

��

�k�H

�ӻ�

�A

��

�A

��

�M

��

�C

Ref 0

For

men,

there

montsuki,

haori,

and

hakama.

Ref 1

There

montsuki,

haori,

and

hakama

for

men.

Ref 2

There

kimono

marked

with

family

crest,

short

formal

coat,

and

wide

trousers

for

men.

Ref 3

There

man's

montsuki,

haori,

and

hakama.

Ref 4

Men

have

the

montsuki,

haori,

and

hakama.

Ref 5

for

the

men,

have

montsuki,

haori,

and

hakama.

Ref 6

For

the

males,

there

montsuki,

haori,

and

hakama.

Ref 7

Men

have

montsuki,

haori,

and

hakama.

Ref 8

for

men,

there's

montsuki,

haori,

and

hakama.

Ref 9

The

male

version

montsuki,

haori,

and

hakama.

Ref 10

Men

wear

montsuki,

haori,

and

hakama.

Ref 11

Men's

traditional

clothes

include

montsuki,

haori,

and

hakama.

Ref 12

Men

usually

wear

montsuki,

haori,

and

hakama.

Ref 13

Men

use

montsuki,

haori

and

hakama.

Ref 14

Men

wear

montsuki,

haori

and

hakama.

Ref 15

Men

have

montsuki,

haori

hakama.

Output 0

the

man,

has

montsuki,

haori

and

hakama.

N-grams

To	the	man,	has	montsuki,	haori	and	hakama.
	the			montsuki,	haori	and	hakama.
					haori and
					haori and hakama.
						and hakama.

Output 1

man

montsuki

haori

and

hakama

the

N-grams

of	man	,	montsuki	,	haori	and	hakama	the	to	.
					haori	and	hakama	the
					haori and

Output 2

Man,

there

montsuki,

haori

and

hakama.

N-grams

Of	Man,	there	montsuki,	haori	and	hakama.
		there	montsuki,	haori	and	hakama.
				haori and
				haori and hakama.
					and hakama.

Output 3

Have

the

��

the

��

the

��

the

��

and

the

��

man.

N-grams

Have

the

��

the

��

the

��

the

��

and

the

��

man.

the

and

Output 4

the

man,

has

montsuki,

haori

and

hakama.

N-grams

To	the	man,	has	montsuki,	haori	and	hakama.
	the			montsuki,	haori	and	hakama.
					haori and
					haori and hakama.
						and hakama.

Sentence 382) BLEU: 0 (0.5714/0.1667/0/0) ; 0 (0.375/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5714/0.1667/0/0) ; 0 (0.5714/0.1667/0/0)

Source

Ѯ�

�u

��

�A

��O

��

�H

Ref 0

It's

hot,

isn't

it?

Ref 1

sure

hot,

isn't

it.

Ref 2

Sure

hot,

isn't

it.

Ref 3

It's

cooking,

isn't

it.

Ref 4

It's

really

hot,

isn't

it?

Ref 5

It's

hot

out,

isn't

it?

Ref 6

Pretty

warm

out,

isn't

it?

Ref 7

sure

hot.

Ref 8

The

temperature's

high,

isn't

it?

Ref 9

feels

hot,

doesn't

it?

Ref 10

Isn't

hot?

Ref 11

It's

got

hot,

hasn't

it?

Ref 12

Don't

you

think

it's

hot?

Ref 13

It's

hot

out,

wouldn't

you

say?

Ref 14

It's

boiling

out,

isn't

it?

Ref 15

sweltering,

isn't

it?

Output 0

The

weather

really

hot,

not

right?

N-grams

The	weather	is	really	hot,	not	right?
The		is	really	hot,
			really hot,

Output 1

really

hot

weather

not

the

N-grams

really	hot	weather	,	is	not	the	?
really	hot			is

Output 2

Really

hot

weather,

not

it?

N-grams

Really	hot	weather,	is	not	it?
	hot		is		it?

Output 3

The

weather

really

hot,

not?

N-grams

The	weather	is	really	hot,	be	not?
The		is	really	hot,
			really hot,

Output 4

The

weather

really

hot,

not

right?

N-grams

The	weather	is	really	hot,	not	right?
The		is	really	hot,
			really hot,

Sentence 383) BLEU: 0 (0.3333/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0/0/0/0)

Source

�n��

�A

��

�o��

�C

Ref 0

Okay,

here,

please.

Ref 1

Okay,

here

would

good.

Ref 2

All

right,

then

here,

please.

Ref 3

So,

here

are,

please.

Ref 4

Well,

it's

here,

please.

Ref 5

Alright,

this

one,

please.

Ref 6

Well

then,

here,

please.

Ref 7

Then,

I'll

take

this

please.

Ref 8

I'll

have

this

room

then.

Ref 9

Here

then.

Ref 10

Could

have

this

room

then?

Ref 11

Okay,

here

fine

please.

Ref 12

Okay,

put

here

please.

Ref 13

Okay,

would

here

please.

Ref 14

Okay,

here,

please.

Ref 15

Okay,

here,

please.

Output 0

Okay,

ask

here.

N-grams

Okay,	ask	here.
Okay,

Output 1

here

N-grams

,	here	.
	here

Output 2

OK,

please

here.

N-grams

OK,

please

here.

Output 3

Okay,

ask

here.

N-grams

Okay,	ask	here.
Okay,

Output 4

Good,

invites

here.

N-grams

Good,

invites

here.

Sentence 384) BLEU: 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.7143/0.1667/0/0) ; 0 (0.6667/0.2/0/0) ; 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.8333/0.4/0/0)

Source

��

�q�`

�O

�h��

��

�H

Ref 0

How

much

normally.

Ref 1

What

the

normal

price?

Ref 2

How

much

does

cost

normally?

Ref 3

Normally,

how

much

would

be?

Ref 4

How

much

does

run

ordinarily?

Ref 5

And

what's

the

normal

cost?

Ref 6

What's

the

normal

price?

Ref 7

What's

the

usual

rate?

Ref 8

What

rate

ordinarily?

Ref 9

Usually,

how

much

does

cost?

Ref 10

What's

the

usual

price?

Ref 11

How

much

would

cost

usually?

Ref 12

What

would

you

pay

normally?

Ref 13

How

much

does

usually

cost?

Ref 14

About

how

much

the

regular

price?

Ref 15

About

how

much

the

usual

charge?

Output 0

How

much

usually?

N-grams

How	much	is	it	usually?
How	much	is	it	usually?
How much		is it
How much is
How much is it
	much is
	much is it

Output 1

usually

how

much

money

N-grams

it	is	usually	how	much	money	?
it	is	usually	how	much
			how much

Output 2

usually

how

much

money?

N-grams

It	is	usually	how	much	money?
	is	usually	how	much
			how much

Output 3

How

much

usually?

N-grams

How	much	is	it	usually?
How	much	is	it	usually?
How much		is it
How much is
How much is it
	much is
	much is it

Output 4

How

much

money

usually?

N-grams

How	much	money	is	it	usually?
How	much		is	it	usually?
How much			is it

Sentence 385) BLEU: 0 (1/1/1/0) ; 0 (0.6667/0.5/0/0) ; 0 (1/1/1/0) ; 0 (1/1/0/0) ; 0 (0.6667/0/0/0)

Source

��

��H��

�C

Ref 0

single

room.

Ref 1

This

single

room.

Ref 2

single

room

what

this

is.

Ref 3

single.

Ref 4

room

for

one.

Ref 5

one-person

room.

Ref 6

single,

please.

Ref 7

I'd

single,

please.

Ref 8

Make

single

room,

please.

Ref 9

Room

for

one.

Ref 10

Room

for

one

person.

Ref 11

room

with

one

bed.

Ref 12

room

for

one

please.

Ref 13

single,

please.

Ref 14

room

for

single

person,

please.

Ref 15

single

room.

Output 0

single

room.

N-grams

A	single	room.
A	single	room.
A single
A single room.
	single room.

Output 1

single

N-grams

a	single	.
a	single
a single

Output 2

single

room.

N-grams

A	single	room.
A	single	room.
A single
A single room.
	single room.

Output 3

single.

N-grams

A	single.
A	single.
A single.

Output 4

Between

single.

N-grams

Between	a	single.
	a	single.

Sentence 386) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.4/0/0/0)

Source

�h

�@��

�n

��

�a��

�C

Ref 0

someplace

good.

Ref 1

someplace

good.

Ref 2

delicious

restaurant.

Ref 3

restaurant

with

good

food.

Ref 4

good

place.

Ref 5

place

with

good

food.

Ref 6

someplace

with

great

food.

Ref 7

Somewhere

tasty.

Ref 8

place

that's

serves

delicious

food.

Ref 9

Someplace

that's

satisfying.

Ref 10

I'd

place

with

good

food.

Ref 11

place

with

good

food,

please.

Ref 12

place

with

good

food.

Ref 13

delicious

place.

Ref 14

good

tasting

place.

Ref 15

somewhere

tasty.

Output 0

some

good

places.

N-grams

Go	to	some	good	places.
Go	to		good
Go to

Output 1

some

good

places

N-grams

go	some	to	good	places	.
go		to	good

Output 2

some

place

nice.

N-grams

Go	some	place	nice.
Go		place

Output 3

some

good

places.

N-grams

Go	to	some	good	places.
Go	to		good
Go to

Output 4

Goes

some

good

places.

N-grams

Goes	to	some	good	places.
	to		good

Sentence 387) BLEU: 0.3549 (0.8/0.5556/0.25/0.1429) ; 0 (0.4/0.25/0/0) ; 0 (0.6/0.5/0.3333/0) ; 0.3549 (0.8/0.5556/0.25/0.1429) ; 0 (0.5/0/0/0)

Source

��

�n

�U

��

�H

Ref 0

have

get

off

the

plane?

Ref 1

Must

get

off

the

plane?

Ref 2

need

get

off

the

plane?

Ref 3

need

disembark

from

the

aircraft?

Ref 4

have

deplane?

Ref 5

Must

get

off

the

plane?

Ref 6

have

leave

the

plane?

Ref 7

Must

get

off

the

plane?

Ref 8

Will

required

disembark?

Ref 9

necessary

for

get

off

the

plane?

Ref 10

supposed

get

off

the

plane?

Ref 11

necessary

leave

the

plane?

Ref 12

Must

leave

the

plane?

Ref 13

required

leave

the

aircraft?

Ref 14

have

de-plane?

Ref 15

need

disembark

the

airplane?

Output 0

have

want

off

the

airplane?

N-grams

Do	I	have	to	want	to	go	off	the	airplane?
Do	I	have	to				off	the	airplane?
Do I		have to					off the
Do I have								the airplane?
Do I have to
	I have
	I have to

Output 1

have

plane

N-grams

i	have	to	plane	?
	have	to
	have to

Output 2

have

plane

it?

N-grams

I	have	to	plane	it?
I	have	to
I have
I have to
	have to

Output 3

have

want

off

the

airplane?

N-grams

Do	I	have	to	want	to	go	off	the	airplane?
Do	I	have	to				off	the	airplane?
Do I		have to					off the
Do I have								the airplane?
Do I have to
	I have
	I have to

Output 4

must

alight

from

plane?

N-grams

I	must	alight	from	a	plane?
I			from		plane?

Sentence 388) BLEU: 0 (1/1/0/0) ; 0 (0/0/0/0) ; 0 (1/1/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0)

Source

��Z

�@�U

�C

Ref 0

Excuse

me.

Ref 1

Pardon

me.

Ref 2

I'm

terribly

sorry.

Ref 3

beg

your

pardon.

Ref 4

Please

forgive

me.

Ref 5

Pardon

me.

Ref 6

Sorry

bother

you.

Ref 7

Sorry.

Ref 8

May

ask

you

something.

Ref 9

Could

disturb

you.

Ref 10

I'm

sorry.

Ref 11

sorry.

Ref 12

Pardon

me.

Ref 13

terribly

sorry

but.

Ref 14

Excuse

me.

Ref 15

Excuse

me.

Output 0

Excuse

me.

N-grams

Excuse	me.
Excuse	me.
Excuse me.

Output 1

N-grams

Output 2

Excuse

me.

N-grams

Excuse	me.
Excuse	me.
Excuse me.

Output 3

Bother

while.

N-grams

Bother

while.

Output 4

Disturbs.

N-grams

Disturbs.

Sentence 389) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.6/0.25/0/0)

Source

�o

��

�s

��

�H

Ref 0

What

this

street

called?

Ref 1

What

the

name

this

street?

Ref 2

What

street

this?

Ref 3

What

you

call

this

street?

Ref 4

What's

the

name

this

street?

Ref 5

What

street

this?

Ref 6

What

people

call

this

street?

Ref 7

What's

the

name

this

street?

Ref 8

What's

this

street

name?

Ref 9

What

you

call

this

street?

Ref 10

What's

the

name

this

street?

Ref 11

What's

this

street's

name?

Ref 12

Could

you

tell

what

this

street's

called?

Ref 13

What

the

name

this

street?

Ref 14

What

you

call

this

street?

Ref 15

What

street

this?

Output 0

What

does

this

street

call?

N-grams

What	does	this	street	call?
What		this	street
		this street

Output 1

this

street

what

does

call

N-grams

this	street	what	does	call	?
this	street	what		call
this street

Output 2

This

street

called?

N-grams

This	street	called?
	street	called?
	street called?

Output 3

What

does

this

street

call?

N-grams

What	does	this	street	call?
What		this	street
		this street

Output 4

What

does

this

street

call?

N-grams

What	does	this	street	call?
What		this	street
		this street

Sentence 390) BLEU: 0.4317 (0.7778/0.625/0.4286/0.1667) ; 0 (0.3333/0.2/0/0) ; 0.4317 (0.7778/0.625/0.4286/0.1667) ; 0 (0/0/0/0) ; 0 (0.2727/0.1/0/0)

Source

��

�n

�@

��

�p

��

�f��

�C

Ref 0

I'd

small

van,

please.

Ref 1

want

small

van,

please.

Ref 2

Please

give

small

van.

Ref 3

small

van,

please.

Ref 4

I'd

have

small

van,

please.

Ref 5

I'd

minivan

please.

Ref 6

want

minivan,

please.

Ref 7

Could

have

small

van,

please?

Ref 8

want

small

van,

please.

Ref 9

I'm

looking

for

small

van,

please.

Ref 10

Can

rent

small

van?

Ref 11

you

have

small

van

available?

Ref 12

possible

rent

small

van?

Ref 13

would

get

small

van,

please.

Ref 14

interested

compact

van,

please.

Ref 15

would

rent

compact

sized

van,

please.

Output 0

would

have

shed

small

truck.

N-grams

I	would	like	to	have	shed	a	small	truck.
I	would	like	to	have		a	small
I would		like to				a small
I would like			to have
I would like to
	would like
	would like to
		like to have

Output 1

have

truck

first

N-grams

i	to	have	truck	first	.
	to	have
	to have

Output 2

would

have

shed

small

truck.

N-grams

I	would	like	to	have	shed	a	small	truck.
I	would	like	to	have		a	small
I would		like to				a small
I would like			to have
I would like to
	would like
	would like to
		like to have

Output 3

first

essentials

smallly

has

Peng

truck.

N-grams

first

essentials

smallly

has

Peng

truck.

Output 4

slightly

take

one

have

the

awning

freight

vehicle

first.

N-grams

I	slightly	take	one	to	have	the	awning	freight	vehicle	first.
I				to	have
				to have

Sentence 391) BLEU: 0 (0.25/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.3333/0/0/0)

Source

�w��

�d�i

�b

��

�H

Ref 0

Where

the

reservation

counter?

Ref 1

Where

the

reservation

counter

located?

Ref 2

Where

can

find

the

reservation

counter?

Ref 3

you

know

where

the

reservation

counter

is?

Ref 4

Where

the

reservation

counter

located?

Ref 5

Where

would

find

the

reservation

counter?

Ref 6

Where

would

the

reservation

counter

be?

Ref 7

Where

would

the

reservation

counter

located?

Ref 8

Could

you

tell

where

the

reservation

counter

is?

Ref 9

What's

the

location

the

reservation

counter?

Ref 10

Where

could

find

the

reservation

counter?

Ref 11

The

reservation

counter,

please.

Ref 12

Could

you

tell

where

the

reservation

counter

is?

Ref 13

Where

can

make

reservations?

Ref 14

Where

the

window

for

making

reservations?

Ref 15

Where

the

wicket

for

making

reservations?

Output 0

Reserve

counter

which?

N-grams

Reserve	a	counter	which?
		counter

Output 1

counter

N-grams

counter	?
counter

Output 2

Booking

counters

where?

N-grams

Booking

counters

where?

Output 3

Reserve

counter

which?

N-grams

Reserve	a	counter	which?
		counter

Output 4

Appointment

counter

in?

N-grams

Appointment	counter	in?
	counter

Sentence 392) BLEU: 0 (0.7143/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.7143/0/0/0) ; 0 (0.5714/0/0/0) ; 0 (0.8333/0.2/0/0)

Source

��

�]��

��

�o��

�C

Ref 0

I'm

here

business.

Ref 1

came

here

business.

Ref 2

came

business.

Ref 3

Here

business.

Ref 4

I'm

here

for

business.

Ref 5

I'm

here

business.

Ref 6

came

for

business

reasons.

Ref 7

I've

come

business.

Ref 8

This

business

trip.

Ref 9

The

purpose

visit

business.

Ref 10

visit

work

related.

Ref 11

I'm

coming

here

business.

Ref 12

came

here

for

work.

Ref 13

here

the

purpose

business.

Ref 14

here

business

trip.

Ref 15

here

conduct

business.

Output 0

come

here

because

the

public.

N-grams

I	come	here	because	of	the	public.
I	come	here		of	the

Output 1

come

here

N-grams

i	come	here	of	on	.
	come	here	of	on

Output 2

come

here

because

the

public.

N-grams

I	come	here	because	of	the	public.
I	come	here		of	the

Output 3

account

duty

come

here.

N-grams

I	on	account	of	duty	come	here.
I	on		of		come

Output 4

come

here

official

business.

N-grams

I	come	here	on	official	business.
I	come	here	on		business.
		here on

Sentence 393) BLEU: 0 (0.6667/0.375/0.1429/0) ; 0 (0.4286/0/0/0) ; 0 (0.6667/0.4/0.25/0) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.5556/0.125/0/0)

Source

��

�餸

�I��

��

�H

Ref 0

Can

pay

yen?

Ref 1

Can

pay

with

Japanese

yen?

Ref 2

Can

buy

this

with

Japanese

yen?

Ref 3

Can

use

Japanese

yen

buy

this?

Ref 4

Can

use

yen

pay?

Ref 5

Can

pay

with

yen?

Ref 6

Can

you

take

yen?

Ref 7

possible

pay

yen?

Ref 8

Will

you

payment

yen?

Ref 9

payment

yen

okay?

Ref 10

Can

use

yen

pay?

Ref 11

possible

pay

yen?

Ref 12

Are

yen

acceptable?

Ref 13

May

use

yen

make

purchase?

Ref 14

May

make

purchases

with

yen?

Ref 15

Can

buy

something

with

yen?

Output 0

can

use

the

Japanese

yen

pay

money?

N-grams

I	can	use	the	Japanese	yen	to	pay	money?
I		use		Japanese	yen	to	pay
				Japanese yen		to pay
				Japanese yen to
					yen to

Output 1

japanese

yen

can

pay

use

N-grams

japanese	yen	can	i	pay	use	?
	yen			pay	use

Output 2

Japanese

Yen

Can

pay

it?

N-grams

Japanese	Yen	Can	I	pay	it?
Japanese		Can	I	pay
		Can I
		Can I pay
			I pay

Output 3

Can

use

yen

payment?

N-grams

Can	I	use	yen	payment?
Can	I	use	yen
Can I		use yen
Can I use
Can I use yen
	I use
	I use yen

Output 4

can

use

the

Japanese

Yen

pay

money?

N-grams

I	can	use	the	Japanese	Yen	to	pay	money?
I		use		Japanese		to	pay
						to pay

Sentence 394) BLEU: 0 (0.375/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.375/0/0/0)

Source

�A

��

�o��

��

�C

Ref 0

They

look

nice

you.

Ref 1

That

looks

great

you.

Ref 2

That

looks

nice

you.

Ref 3

You

look

good

that.

Ref 4

They

look

really

good

you.

Ref 5

They're

just

perfect

for

you.

Ref 6

They

are

you.

Ref 7

That

really

suits

you.

Ref 8

That

looks

smashing.

Ref 9

They

look

hot

you.

Ref 10

They

fit

you.

Ref 11

They

suit

you.

Ref 12

They're

just

right

you.

Ref 13

They

suit

you

very

well.

Ref 14

They

well

with

you.

Ref 15

looks

good

you.

Output 0

You

put

these

very

beautiful.

N-grams

You	put	on	these	to	be	very	beautiful.
You		on				very

Output 1

you

wear

these

beautiful

very

N-grams

you	wear	these	beautiful	very	.
you				very

Output 2

You

wear

these

beautiful.

N-grams

You	wear	these	beautiful.
You

Output 3

You

wear

these

very

beautiful.

N-grams

You	wear	these	very	beautiful.
You			very

Output 4

You

put

these

very

beautiful.

N-grams

You	put	on	these	to	be	very	beautiful.
You		on				very

Sentence 395) BLEU: 0 (0.3333/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.5/0/0/0)

Source

�c�˳��

��

�b

��

�H

Ref 0

Where

the

Luxembourg

Hotel?

Ref 1

you

know

where

the

Luxembourg

Hotel

is?

Ref 2

Where

the

Luxembourg

Hotel

located?

Ref 3

Where

can

find

the

Luxembourg

Hotel?

Ref 4

Where

the

Luxembourg

Hotel

located?

Ref 5

Where

would

the

Luxembourg

Hotel

be?

Ref 6

Where

would

find

the

Luxembourg

Hotel?

Ref 7

Where

would

the

Luxembourg

Hotel

situated?

Ref 8

Where

would

find

the

Luxembourg

hotel?

Ref 9

Could

you

tell

where

the

Luxembourg

hotel

is?

Ref 10

The

Luxembourg

Hotel

please.

Ref 11

Where

can

find

the

Luxembourg

Hotel?

Ref 12

Could

you

tell

where

the

Luxembourg

Hotel

is?

Ref 13

Where

can

find

the

Luxembourg

Hotel?

Ref 14

What

the

location

the

Luxembourg

Hotel?

Ref 15

Where

the

Luxembourg

Hotel

located?

Output 0

Which

Park

Hotel

luxemburg?

N-grams

Which	is	Park	Hotel	in	luxemburg?
	is		Hotel

Output 1

luxembourg

park

hotel

N-grams

luxembourg	park	hotel	in	?
		hotel

Output 2

Luxembourg

Park

Hotel

where?

N-grams

Luxembourg	Park	Hotel	where?
Luxembourg		Hotel

Output 3

Which

park

hotel

Luxemburg

N-grams

Which	is	park	hotel	in	Luxemburg	?
	is		hotel

Output 4

Luxembourg

Park

Hotel

in?

N-grams

Luxembourg	Park	Hotel	in?
Luxembourg		Hotel

Sentence 396) BLEU: 0 (0.4286/0.1667/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.1429/0/0/0)

Source

��

�}

��

�H

Ref 0

Can

have

receipt,

please?

Ref 1

Receipt,

please.

Ref 2

Please

give

receipt.

Ref 3

I'd

receipt,

please.

Ref 4

Could

get

receipt,

please?

Ref 5

receipt,

please.

Ref 6

I'd

receipt,

please.

Ref 7

I'd

receipt,

please.

Ref 8

Could

get

receipt,

please?

Ref 9

Please

give

receipt.

Ref 10

would

receipt.

Ref 11

receipt,

please.

Ref 12

Could

you

hand

the

receipt?

Ref 13

Could

you

give

receipt,

please?

Ref 14

May

get

receipt,

please.

Ref 15

Please

write

receipt.

Output 0

Can

open

receipt

for

it?

N-grams

Can	I	open	a	receipt	for	it?
Can	I		a
Can I

Output 1

can

open

receipt

for

N-grams

can	open	a	receipt	for	me	?
		a			me

Output 2

Can

open

receipt

for

it?

N-grams

Can	I	open	a	receipt	for	it?
Can	I		a
Can I

Output 3

Can

open

receipt

for

me?

N-grams

Can	open	a	receipt	for	me?
Can		a

Output 4

Can

open

informal

receipt

me?

N-grams

Can	open	an	informal	receipt	to	me?
Can

Sentence 397) BLEU: 0 (0.7143/0.3333/0/0) ; 0 (0/0/0/0) ; 0 (0.75/0/0/0) ; 1 (1/1/1/1) ; 0 (0.7143/0.3333/0/0)

Source

��

�L�k

�J��

�C

Ref 0

can't

sleep.

Ref 1

can't

fall

asleep.

Ref 2

I'm

having

trouble

sleeping.

Ref 3

have

insomnia.

Ref 4

can't

fall

asleep.

Ref 5

I'm

not

sleeping.

Ref 6

can't

get

sleep.

Ref 7

can't

get

any

sleep.

Ref 8

I'm

not

able

sleep.

Ref 9

have

insomnia.

Ref 10

not

able

sleep.

Ref 11

have

insomnia.

Ref 12

can't

get

sleep.

Ref 13

have

trouble

sleeping.

Ref 14

can't

fall

asleep.

Ref 15

can't

get

sleep.

Output 0

unable

sleep.

N-grams

I	am	unable	to	go	to	sleep.
I	am		to		to sleep.
I am						sleep.

Output 1

can

sleep

N-grams

can

sleep

Output 2

can

not

sleep.

N-grams

I	can	not	sleep.
I		not	sleep.

Output 3

can't

fall

asleep.

N-grams

I	can't	fall	asleep.
I	can't	fall	asleep.
I can't		fall asleep.
I can't fall
I can't fall asleep.
	can't fall
	can't fall asleep.

Output 4

unable

sleep.

N-grams

I	am	unable	to	go	to	sleep.
I	am		to		to sleep.
I am						sleep.

Sentence 398) BLEU: 0 (0.25/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.8333/0/0/0) ; 0 (0.8/0.25/0/0)

Source

�o

��

�H

��

�ɻ�

�C

Ref 0

The

people

here

are

chic.

Ref 1

These

people

are

chic.

Ref 2

These

people

are

fashionable.

Ref 3

These

people

are

hip.

Ref 4

The

people

here

look

put

together.

Ref 5

The

people

here

look

good.

Ref 6

The

people

here

really

know

how

dress.

Ref 7

The

customers

here

seem

very

stylish.

Ref 8

This

quite

the

trendy

hangout,

isn't

it?

Ref 9

This

seems

the

hip

place

be.

Ref 10

There

are

elegant

people

here.

Ref 11

How

chic

the

people

are

here.

Ref 12

This

place

full

chic

people.

Ref 13

The

people

here

are

very

stylish.

Ref 14

The

people

here

are

very

fashionable.

Ref 15

The

people

here

dress

well.

Output 0

It's

very

fashionable

person.

N-grams

It's	very	fashionable	person.
	very

Output 1

very

fashionable

person

this

N-grams

very	fashionable	person	this	is	.
very				is

Output 2

It's

very

fashionable

person.

N-grams

It's	very	fashionable	person.
	very

Output 3

This

the

person

fashionable.

N-grams

This	of	the	person	is	fashionable.
This	of	the		is	fashionable.

Output 4

This

person

very

fashionable.

N-grams

This	person	is	very	fashionable.
This		is	very	fashionable.
			very fashionable.

Sentence 399) BLEU: 0 (0.2/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.6/0.5/0/0) ; 0 (0/0/0/0)

Source

�S��

��

�⨮

�H

Ref 0

No	limousine?

Ref 1

you

have

limousine?

Ref 2

You

don't

have

limousine?

Ref 3

You

haven't

got

limousine?

Ref 4

There's

limo?

Ref 5

You

don't

have

limousine?

Ref 6

You

haven't

got

limo?

Ref 7

Isn't

there

limousine?

Ref 8

Doesn't

limousine

run

from

here?

Ref 9

Can't

take

limousine?

Ref 10

there

limousine

service?

Ref 11

Are

there

limousines

available?

Ref 12

Isn't

there

limousine?

Ref 13

Aren't

there

any

limousines?

Ref 14

Isn't

there

limousine

available?

Ref 15

Are

there

limousines?

Output 0

There

luxury

car?

N-grams

There	is	no	luxury	car?
		no

Output 1

there

luxury

car

N-grams

there	luxury	car	?
there

Output 2

There

luxury

car?

N-grams

There	is	no	luxury	car?
		no

Output 3

Isn't

there

any

luxurious

car?

N-grams

Isn't	there	any	luxurious	car?
Isn't	there	any
Isn't there
	there any

Output 4

Without

the

luxury

car?

N-grams

Without

the

luxury

car?

Sentence 400) BLEU: 0 (0.7143/0.5/0.2/0) ; 0 (0.4444/0/0/0) ; 0 (0.7143/0.5/0.2/0) ; 0 (0.4545/0.2/0/0) ; 0 (0.7143/0.3333/0/0)

Source

�b

�C

��

�A

�饻

�
��

�ݢ��

�`

�C

Ref 0

the

middle

July,

Tokyo

holds

the

Obon

Festival.

Ref 1

The

Obon

Festival

held

the

middle

July

Tokyo.

Ref 2

Tokyo

celebrates

the

Obon

Festival

the

middle

July.

Ref 3

mid-July,

the

Festival

the

Dead

celebrated

Tokyo.

Ref 4

mid-July,

Tokyo

has

the

Obon

Festival.

Ref 5

mid-July,

there

Obon

Festival

Tokyo.

Ref 6

the

middle

part

July,

Tokyo

celebrates

the

Obon

Festival.

Ref 7

There's

Obon

Festival

Tokyo

mid-July.

Ref 8

The

Obon

Festival

held

Tokyo

mid-July.

Ref 9

Tokyo

has

their

Obon

Festival

mid-July.

Ref 10

The

Obon

Festival

the

middle

July

Tokyo.

Ref 11

Tokyo

there

the

Obon

Festival

the

middle

July.

Ref 12

Tokyo's

Obon

Festival

held

mid-July.

Ref 13

mid

July,

Tokyo

has

its

Obon

Festival.

Ref 14

Tokyo

has

its

Obon

festival

about

the

middle

July.

Ref 15

mid

July,

Tokyo

puts

its

Obon

Festival.

Output 0

mid-July,

the

Japanese

Obon

festival

organized.

N-grams

In	mid-July,	the	Japanese	Obon	festival	organized.
In	mid-July,	the		Obon	festival
In mid-July,				Obon festival
In mid-July, the
	mid-July, the

Output 1

mid-july

the

obon

festival

japan

holds

N-grams

in	mid-july	,	the	obon	festival	japan	holds	.
in			the		festival		holds

Output 2

mid-July,

the

Japanese

Obon

Festival

organized.

N-grams

In	mid-July,	the	Japanese	Obon	Festival	organized.
In	mid-July,	the		Obon	Festival
In mid-July,				Obon Festival
In mid-July, the
	mid-July, the

Output 3

mid-

July,

Japan

holds

the

stanza

the

�ݢ��

N-grams

At	mid-	July,	Japan	holds	the	stanza	of	the	�ݢ��	.
		July,		holds	the		of	the
				holds the			of the

Output 4

mid-July,

Japan

holds

Obon

festival

celebration.

N-grams

In	mid-July,	Japan	holds	Obon	festival	celebration.
In	mid-July,		holds	Obon	festival
In mid-July,				Obon festival

Sentence 401) BLEU: 0 (0.6667/0.25/0.1429/0) ; 0 (0.4286/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6667/0.25/0.1429/0) ; 0 (0.2857/0/0/0)

Source

�i�D

��

�ڭ�

�n

��[

��

�a��

�C

Ref 0

Tell

the

places

we'll

visit.

Ref 1

Tell

where

we'll

visit.

Ref 2

Tell

where

we'll

go.

Ref 3

Please

tell

the

places

we'll

and

see.

Ref 4

Tell

about

the

places

we'll

see.

Ref 5

Tell

about

the

places

we're

going

go.

Ref 6

Give

idea

about

the

places

we're

going

to.

Ref 7

Could

you

give

idea

the

sites

we're

going

visit?

Ref 8

Could

you

tell

where

we're

going?

Ref 9

I'd

know

what

we're

going

see.

Ref 10

Which

places

will

visit?

Ref 11

What

are

going

see?

Ref 12

What

places

will

see?

Ref 13

Please

explain

about

the

places

we'll

seeing.

Ref 14

Please

tell

about

the

places

we'll

see.

Ref 15

Please

tell

where

we'll

seeing.

Output 0

Tell

the

place

that

want

visit.

N-grams

Tell	me	the	place	that	we	want	to	visit.
Tell	me	the			we		to	visit.
Tell me
Tell me the
	me the

Output 1

visit

the

place

N-grams

i	we	to	visit	the	place	.
	we	to		the

Output 2

told

have

visit

the

place.

N-grams

I	am	told	we	have	to	visit	the	place.
			we		to		the

Output 3

Tell

the

place

that

want

visit.

N-grams

Tell	me	the	place	that	we	want	to	visit.
Tell	me	the			we		to	visit.
Tell me
Tell me the
	me the

Output 4

Tells

place

which

must

visit.

N-grams

Tells	place	which	I	we	must	visit.
				we		visit.

Sentence 402) BLEU: 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.6667/0.4/0.25/0) ; 0.3656 (0.625/0.4286/0.3333/0.2) ; 0.7598 (0.8333/0.8/0.75/0.6667) ; 0.7071 (1/0.75/0.6667/0.5)

Source

�藍�_

�A

�o

�O

��

�y��

�C

Ref 0

Excuse

me,

this

seat.

Ref 1

I'm

sorry,

but

this

seat.

Ref 2

Excuse

me,

but

this

seat.

Ref 3

Excuse

me,

but

you

are

sitting

seat.

Ref 4

Sorry,

but

this

seat

mine.

Ref 5

I'm

sorry,

but

this

seat.

Ref 6

Pardon

me,

but

believe

this

seat

mine.

Ref 7

Sorry,

but

this

seat.

Ref 8

Pardon

me,

but

was

sitting

here.

Ref 9

Sorry,

but

this

seat

taken.

Ref 10

I'm

sorry

but

this

seat.

Ref 11

Sorry,

I'm

sitting

here.

Ref 12

Sorry

but

you've

taken

seat.

Ref 13

I'm

sorry,

this

seat.

Ref 14

Excuse

me,

afraid

that

this

seat.

Ref 15

I'm

sorry,

believe

you

are

seat.

Output 0

Sorry,

this

seat.

N-grams

Sorry,	this	is	my	seat.
Sorry,	this	is	my	seat.
	this is		my seat.
	this is my
	this is my seat.
		is my
		is my seat.

Output 1

this

seat

N-grams

,	this	is	my	seat	.
	this	is	my	seat
	this is
	this is my
		is my

Output 2

beg

your

pardon,

this

seat.

N-grams

I	beg	your	pardon,	this	is	my	seat.
I				this	is	my	seat.
				this is		my seat.
				this is my
				this is my seat.
					is my
					is my seat.

Output 3

Execuse

me,

this

seat.

N-grams

Execuse	me,	this	is	my	seat.
	me,	this	is	my	seat.
	me, this		is my
	me, this is			my seat.
	me, this is my
		this is
		this is my
		this is my seat.
			is my seat.

Output 4

Sorry,

this

seat.

N-grams

Sorry,	this	is	my	seat.
Sorry,	this	is	my	seat.
	this is		my seat.
	this is my
	this is my seat.
		is my
		is my seat.

Sentence 403) BLEU: 0 (0.7143/0.5/0/0) ; 0 (0.4286/0/0/0) ; 0.7598 (0.8333/0.8/0.75/0.6667) ; 0 (0.7143/0.5/0/0) ; 0 (0.5714/0.1667/0/0)

Source

�o

�O

��

�e

��

§��

�C

Ref 0

This

present

from

me.

Ref 1

This

present

one

from

me.

Ref 2

This

present

from

me.

Ref 3

This

gift

from

me.

Ref 4

This

gift

from

me.

Ref 5

This

present

from

me.

Ref 6

This

present

from

me.

Ref 7

This

gift

you.

Ref 8

This

something

that

got

for

you.

Ref 9

This

present

from

me.

Ref 10

present

from

me.

Ref 11

Something

from

you.

Ref 12

This

gift

from

me.

Ref 13

This

gift

that

from

me.

Ref 14

brought

this

gift

for

you.

Ref 15

This

present

from

me.

Output 0

This

the

gift

that

send.

N-grams

This	is	the	gift	that	I	send.
This	is		gift	that	I
This is			gift that
				that I

Output 1

this

gift

send

the

N-grams

this	is	gift	send	the	i	.
this	is	gift

Output 2

This

gift

send.

N-grams

This	is	my	gift	to	send.
This	is	my	gift	to
This is		my gift
This is my			gift to
This is my gift
	is my
	is my gift
	is my gift to
		my gift to

Output 3

This

the

gift

that

send.

N-grams

This	is	the	gift	that	I	send.
This	is		gift	that	I
This is			gift that
				that I

Output 4

This

the

gift

which

deliver.

N-grams

This	is	the	gift	which	I	deliver.
This	is		gift		I
This is

Sentence 404) BLEU: 0.8801 (1/1/0.8/0.75) ; 0 (0.7143/0.3333/0.2/0) ; 0.8801 (1/1/0.8/0.75) ; 0 (0.4444/0.125/0/0) ; 0 (0.7778/0.375/0/0)

Source

��

�F

��

�]

�C

��

�@��

�b

�̭�

�C

Ref 0

lost

bag.

passport

was

it.

Ref 1

bag

was

lost.

passport

was

inside

it.

Ref 2

bag

gone.

had

passport

inside

it.

Ref 3

bag

lost.

passport

was

inside

it.

Ref 4

I've

lost

bag.

had

passport

inside.

Ref 5

bag

missing.

kept

passport

it.

Ref 6

bag

gone.

had

passport

inside

it.

Ref 7

I've

misplaced

bag.

left

passport

it.

Ref 8

bag

missing.

put

passport

there.

Ref 9

bag's

gone.

And

inside

was

passport.

Ref 10

can't

find

bag.

had

passport

it.

Ref 11

bag

got

lost.

passport

was

inside.

Ref 12

How

unlucky

that

bag's

lost.

There

was

passport

it.

Ref 13

have

lost

bag.

was

passport.

Ref 14

have

lost

bag.

contained

passport.

Ref 15

have

lost

bag.

had

passport

it.

Output 0

lost

bag.

passport

inside.

N-grams

I	lost	my	bag.	My	passport	inside.
I	lost	my	bag.	My	passport	inside.
I lost		my bag.		My passport
I lost my			bag. My		passport inside.
I lost my bag.
	lost my		bag. My passport
	lost my bag.
	lost my bag. My
		my bag. My
		my bag. My passport

Output 1

passport

inside

N-grams

i	my	my	passport	inside	in	.
	my	my	passport	inside	in
		my passport
		my passport inside
			passport inside

Output 2

lost

bag.

passport

inside.

N-grams

I	lost	my	bag.	My	passport	inside.
I	lost	my	bag.	My	passport	inside.
I lost		my bag.		My passport
I lost my			bag. My		passport inside.
I lost my bag.
	lost my		bag. My passport
	lost my bag.
	lost my bag. My
		my bag. My
		my bag. My passport

Output 3

threw

wrap.

passport

in.

N-grams

I	threw	my	to	wrap.	My	passport	at	in.
I		my			My	passport
					My passport

Output 4

have

thrown

package.

passport

inside.

N-grams

I	have	thrown	my	package.	My	passport	in	inside.
I	have		my		My	passport	in	inside.
I have					My passport
						passport in

Sentence 405) BLEU: 0.5681 (0.8125/0.6667/0.5/0.3846) ; 0.3446 (0.7333/0.5/0.2308/0.1667) ; 0.5681 (0.8125/0.6667/0.5/0.3846) ; 0.7825 (0.9286/0.8462/0.75/0.6364) ; 0.5565 (0.8571/0.6154/0.5/0.3636)

Source

��

�

�b

�o��

��

�C

�A

��

�q��

��

�H

Ref 0

I'll

here

until

the

day

after

tomorrow.

Can

you

order

for

me?

Ref 1

I'll

staying

for

two

days.

Can

you

order

for

me?

Ref 2

I'll

here

for

two

days.

Can

you

get

here

for

then?

Ref 3

I'll

stay

for

two

days.

Can

you

get

then?

Ref 4

I'm

going

here

until

the

day

after

tomorrow.

Could

you

order

for

me?

Ref 5

I'll

staying

until

the

day

after

tomorrow.

Could

you

put

order

for

me?

Ref 6

I'm

going

stay

until

the

day

after

tomorrow.

Would

you

place

order

for

me?

Ref 7

I'm

staying

until

the

day

after

tomorrow.

Would

possible

order

for

me?

Ref 8

I'm

planning

here

until

the

day

after

tomorrow.

Could

you

order

in?

Ref 9

I'll

around

until

the

day

after

next.

Would

you

able

order

for

me?

Ref 10

I'll

stay

here

until

the

day

after

tomorrow.

Would

you

mind

ordering

for

me?

Ref 11

staying

here

another

two

days.

May

have

ordered?

Ref 12

here

until

the

day

after

tomorrow.

Please

order

for

me.

Ref 13

will

here

for

two

days.

Can

you

order

for

me?

Ref 14

will

leaving

the

day

after

tomorrow.

Can

ordered

for

me?

Ref 15

will

here

for

only

two

days.

Can

you

handle

for

me?

Output 0

will

here

until

the

day

after

tomorrow.

You

can

for

order

it?

N-grams

will

here

until

the

day

after

tomorrow.

You

can

for

order

it?

will

here

until

the

day

after

tomorrow.

for

order

I will

be here

until the

day after

for me

to order

I will be

here until

the day

after tomorrow.

I will be here

until the day

will be

here until the

day after tomorrow.

will be here

until the day after

be here until

the day after

be here until the

here until the day

the day after tomorrow.

Output 1

will

here

until

the

day

after

tomorrow

you

can

for

order

N-grams

will

here

until

the

day

after

tomorrow

you

can

for

order

will

here

until

the

day

after

you

for

order

will here

until the

day after

for me

order it

here until

the day

here until the

here until the day

until the day

until the day after

the day after

Output 2

will

here

until

the

day

after

tomorrow.

You

can

for

order

it?

N-grams

will

here

until

the

day

after

tomorrow.

You

can

for

order

it?

will

here

until

the

day

after

tomorrow.

for

order

I will

be here

until the

day after

for me

to order

I will be

here until

the day

after tomorrow.

I will be here

until the day

will be

here until the

day after tomorrow.

will be here

until the day after

be here until

the day after

be here until the

here until the day

the day after tomorrow.

Output 3

will

here

till

the

day

after

tomorrow.

Can

you

order

for

me?

N-grams

will

here

till

the

day

after

tomorrow.

Can

you

order

for

me?

will

here

the

day

after

tomorrow.

Can

you

order

for

me?

I will

the day

after tomorrow.

Can you

order it

for me?

I will here

the day after

tomorrow. Can

you order

it for

will here

the day after tomorrow.

Can you order

it for me?

day after

tomorrow. Can you

order it for

day after tomorrow.

Can you order it

day after tomorrow. Can

you order it

after tomorrow. Can

you order it for

after tomorrow. Can you

order it for me?

tomorrow. Can you order

Output 4

here

until

the

day

after

tomorrow.

You

can

order

for

me?

N-grams

here

until

the

day

after

tomorrow.

You

can

order

for

me?

here

until

the

day

after

tomorrow.

order

for

me?

here until

the day

after tomorrow.

order it

for me?

here until the

day after

order it for

here until the day

order it for me?

until the

day after tomorrow.

it for

until the day

it for me?

until the day after

the day after

the day after tomorrow.

Sentence 406) BLEU: 1 (1/1/1/1) ; 0 (0.5/0.4/0.25/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 1 (1/1/1/1)

Source

��

�Q

�n

�h

��

�C

Ref 0

I'd

fishing.

Ref 1

want

fishing.

Ref 2

Fishing

what

want

do.

Ref 3

want

fish.

Ref 4

I'm

interested

going

fishing.

Ref 5

want

fishing.

Ref 6

I'm

hoping

fishing.

Ref 7

want

fishing.

Ref 8

feel

going

fishing.

Ref 9

I'm

eager

fishing.

Ref 10

May

fishing?

Ref 11

want

some

fishing.

Ref 12

would

nice

fishing.

Ref 13

would

fish.

Ref 14

want

fish.

Ref 15

want

and

fish.

Output 0

want

fishing.

N-grams

I	want	to	go	fishing.
I	want	to	go	fishing.
I want		to go
I want to			go fishing.
I want to go
	want to
	want to go
	want to go fishing.
		to go fishing.

Output 1

want

fishing

N-grams

i	want	to	go	fishing	.
	want	to	go
	want to
	want to go
		to go

Output 2

want

fishing.

N-grams

I	want	to	go	fishing.
I	want	to	go	fishing.
I want		to go
I want to			go fishing.
I want to go
	want to
	want to go
	want to go fishing.
		to go fishing.

Output 3

want

fishing.

N-grams

I	want	to	go	fishing.
I	want	to	go	fishing.
I want		to go
I want to			go fishing.
I want to go
	want to
	want to go
	want to go fishing.
		to go fishing.

Output 4

want

fish.

N-grams

I	want	to	fish.
I	want	to	fish.
I want		to fish.
I want to
I want to fish.
	want to
	want to fish.

Sentence 407) BLEU: 0 (0.2727/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.4444/0.125/0/0) ; 0 (0.3/0/0/0)

Source

��W

��I

�b

��

�_��

�C

Ref 0

Wake

precisely

six

thirty

a.m.

Ref 1

Please

wake

the

morning

six

thirty

sharp.

Ref 2

six

thirty

sharp,

please

wake

the

morning.

Ref 3

the

morning

please

wake

six

thirty

sharp.

Ref 4

Please

wake

exactly

six

thirty

the

morning.

Ref 5

Please

wake

the

morning

six

thirty

sharp.

Ref 6

Please

wake

six

thirty

a.m.

the

dot.

Ref 7

Would

you

wake

the

morning

exactly

six

thirty?

Ref 8

Please

wake

six

thirty

a.m.

sharp.

Ref 9

want

woken

six

thirty

the

morning

sharp.

Ref 10

Could

you

wake

exactly

six

thirty

a.m.?

Ref 11

Please

wake

six

thirty

the

dot.

Ref 12

would

the

wake-up

call

exactly

six

thirty

a.m.

Ref 13

Please

wake

exactly

six

thirty

a.m.

Ref 14

Please

wake

exactly

six

thirty

the

morning.

Ref 15

would

woken

exactly

six

thirty

a.m.

Output 0

exactly

shouted

get

out

bed.

N-grams

At	exactly	6:	30	am	shouted	I	get	out	of	bed.
At	exactly					I

Output 1

whole

get

N-grams

6	:	30	am	i	up	whole	get	at	.
					up			at

Output 2

6:30

wake

crying

the

whole.

N-grams

6:30	am	I	wake	up	crying	the	whole.
		I	wake	up		the

Output 3

Whole

shout

get

6:30

a.m..

N-grams

Whole	shout	me	to	get	up	at	6:30	a.m..
		me	to		up	at
					up at

Output 4

exactly

6:30

shouted

get

out

bed.

N-grams

At	exactly	6:30	am	shouted	I	get	out	of	bed.
At	exactly				I

Sentence 408) BLEU: 0 (0.4/0/0/0) ; 0 (0.4286/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�S��

�o��

�Q

�C

Ref 0

don't

suppose

so.

Ref 1

guess

not.

Ref 2

suppose

not.

Ref 3

Probably

not.

Ref 4

don't

think

that's

likely

the

case.

Ref 5

don't

think

that's

probably

how

is.

Ref 6

wouldn't

consider

that

likely.

Ref 7

That's

probably

not

the

case.

Ref 8

don't

think

that's

right.

Ref 9

That's

not

what

think.

Ref 10

wouldn't

think

so.

Ref 11

Probably

not.

Ref 12

guess

not.

Ref 13

don't

think

so.

Ref 14

Perhaps

not.

Ref 15

Maybe

not.

Output 0

didn't

think

this.

N-grams

I	didn't	think	like	this.
I		think

Output 1

not

think

this

N-grams

i	not	to	think	like	this	.
	not	to	think

Output 2

did

not

want

to.

N-grams

I	did	not	want	to.
I		not

Output 3

didn't

think

this.

N-grams

I	didn't	think	like	this.
I		think

Output 4

not

have

think

this.

N-grams

I	do	not	have	to	think	like	this.
I		not		to	think

Sentence 409) BLEU: 1 (1/1/1/1) ; 0 (0.4286/0/0/0) ; 1 (1/1/1/1) ; 0 (0.6/0.1111/0/0) ; 0 (0.5/0.2857/0.1667/0)

Source

��

�Q

�n

�@��

�cŽ�I

�C

Ref 0

I'd

some

shaving

cream.

Ref 1

want

some

shaving

cream.

Ref 2

I'm

looking

for

some

shaving

cream.

Ref 3

would

buy

some

shaving

cream.

Ref 4

need

some

shaving

cream.

Ref 5

want

some

shaving

cream.

Ref 6

I'm

looking

for

some

shaving

cream.

Ref 7

want

some

shaving

cream.

Ref 8

I'm

looking

for

some

shaving

cream.

Ref 9

Could

you

give

some

shaving

cream?

Ref 10

want

some

shaving

cream.

Ref 11

Some

shaving

cream,

please.

Ref 12

Could

have

some

shaving

cream?

Ref 13

looking

for

shaving

cream.

Ref 14

would

buy

shaving

cream.

Ref 15

want

shaving

cream.

Output 0

I'd

some

shaving

cream.

N-grams

I'd	like	some	shaving	cream.
I'd	like	some	shaving	cream.
I'd like		some shaving
I'd like some			shaving cream.
I'd like some shaving
	like some
	like some shaving
	like some shaving cream.
		some shaving cream.

Output 1

some

cream

want

shave

N-grams

i	some	cream	want	to	shave	.
	some		want	to

Output 2

I'd

some

shaving

cream.

N-grams

I'd	like	some	shaving	cream.
I'd	like	some	shaving	cream.
I'd like		some shaving
I'd like some			shaving cream.
I'd like some shaving
	like some
	like some shaving
	like some shaving cream.
		some shaving cream.

Output 3

want

some

shave

beard

cream.

N-grams

I	want	to	be	some	to	shave	a	beard	cream.
I	want	to		some					cream.
I want

Output 4

want

some

shave

must

the

paste.

N-grams

I	want	some	to	shave	must	the	paste.
I	want	some	to
I want
I want some
	want some

Sentence 410) BLEU: 0 (0.6/0/0/0) ; 0 (0/0/0/0) ; 0 (0.6/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�H

Ref 0

there

catch

limit?

Ref 1

there

limit

how

much

catch?

Ref 2

there

limit

how

much

can

catch?

Ref 3

you

have

catch

limit?

Ref 4

there

limit

the

catch?

Ref 5

there

limit

how

many

you

can

catch?

Ref 6

they

have

limit

the

catch?

Ref 7

you

know

there

limit

catches?

Ref 8

Would

there

catch

limit?

Ref 9

catch

limit

effect?

Ref 10

there

limit

the

fishes

can

catch?

Ref 11

Would

there

catch

limit?

Ref 12

there

catch

limit

effect?

Ref 13

there

limit

how

many

can

keep?

Ref 14

there

limit

how

many

can

catch?

Ref 15

there

maximum

how

many

can

catch?

Output 0

Restrictions

have

catch

it?

N-grams

Restrictions	have	to	catch	it?
	have	to	catch

Output 1

N-grams

Output 2

Restrictions

have

catch

it?

N-grams

Restrictions	have	to	catch	it?
	have	to	catch

Output 3

Caught

restriction?

N-grams

Caught

restriction?

Output 4

Has

the

capture

limit?

N-grams

Has	the	capture	limit?
	the		limit?

Sentence 411) BLEU: 0.4347 (0.7143/0.5/0.4/0.25) ; 0 (0.375/0.2857/0.1667/0) ; 0.6435 (0.8571/0.6667/0.6/0.5) ; 0.4347 (0.7143/0.5/0.4/0.25) ; 0 (0.5/0.2857/0.1667/0)

Source

��

�Q

��

�i��

�C

Ref 0

I'd

see

the

show

tonight.

Ref 1

Tonight

when

would

see

the

show.

Ref 2

want

see

the

show

tonight.

Ref 3

Tonight,

would

see

the

show.

Ref 4

feel

going

see

the

show

tonight.

Ref 5

want

see

the

show

tonight.

Ref 6

I'm

interested

going

see

the

show

this

evening.

Ref 7

want

catch

the

show

tonight.

Ref 8

I'm

interested

watching

tonight's

show.

Ref 9

I'm

hoping

see

the

show

this

evening.

Ref 10

want

watch

the

show

tonight.

Ref 11

interested

going

tonight's

show.

Ref 12

May

watch

tonight's

show.

Ref 13

would

see

tonight's

show.

Ref 14

would

see

this

evening's

presentation.

Ref 15

would

this

the

show

that's

tonight.

Output 0

want

see

that

exhibition

tonight.

N-grams

I	want	to	see	that	exhibition	tonight.
I	want	to	see			tonight.
I want		to see
I want to
I want to see
	want to
	want to see

Output 1

tonight

want

see

exhibition

that

N-grams

tonight	i	want	to	see	exhibition	that	.
		want	to	see
		want to
		want to see
			to see

Output 2

Tonight

want

see

the

exhibition.

N-grams

Tonight	I	want	to	see	the	exhibition.
Tonight	I	want	to	see	the
	I want		to see
	I want to			see the
	I want to see
		want to
		want to see
		want to see the
			to see the

Output 3

want

see

that

exhibition

tonight.

N-grams

I	want	to	see	that	exhibition	tonight.
I	want	to	see			tonight.
I want		to see
I want to
I want to see
	want to
	want to see

Output 4

want

look

that

display

tonight.

N-grams

I	want	to	look	at	that	display	tonight.
I	want	to					tonight.
I want
I want to
	want to

Sentence 412) BLEU: 0.4671 (0.6667/0.5/0.4286/0.3333) ; 0 (0.375/0.1429/0/0) ; 0.4617 (0.9091/0.6/0.3333/0.25) ; 0.4671 (0.6667/0.5/0.4286/0.3333) ; 0 (0.4444/0/0/0)

Source

��

�o��

�u�`

��

�ɻ�

��

�C��

�C

Ref 0

Please

show

the

newest

colors

for

this

season.

Ref 1

Please

show

what

colors

are

for

this

season.

Ref 2

Please

show

the

colors

for

this

season.

Ref 3

Please

show

this

season's

colors.

Ref 4

Please

let

see

this

season's

newest

colors.

Ref 5

Please

give

look

this

season's

newest

colors.

Ref 6

Please

show

this

season's

latest

colors.

Ref 7

Would

you

show

this

season's

latest

colors?

Ref 8

Could

see

the

newest

colors

this

season?

Ref 9

I'd

see

the

latest

colors

this

season.

Ref 10

Could

have

look

this

season's

newest?

Ref 11

I'd

you

show

the

newest

colors

for

this

season.

Ref 12

want

see

the

latest

colors

for

this

season?

Ref 13

Please

show

the

most

recent

colors

the

season.

Ref 14

Please

show

the

season's

new

colors.

Ref 15

Please

show

the

latest

colors

for

this

season.

Output 0

Please

let

see

this

season

most

fashionable

color.

N-grams

Please	let	me	see	this	season	most	fashionable	color.
Please	let	me	see	this		most
Please let		me see
Please let me			see this
Please let me see
	let me
	let me see
	let me see this
		me see this

Output 1

please

this

season

most

fashionable

color

N-grams

please	me	this	season	most	fashionable	color	.
	me	this		most
	me this

Output 2

Please

give

look

this

season's

most

fashionable

colors.

N-grams

Please	give	me	a	look	of	this	season's	most	fashionable	colors.
Please	give	me	a	look	of	this	season's	most		colors.
Please give		me a			of this
Please give me			a look			this season's
Please give me a
	give me
	give me a
	give me a look
		me a look

Output 3

Please

let

see

this

season

most

fashionable

color.

N-grams

Please	let	me	see	this	season	most	fashionable	color.
Please	let	me	see	this		most
Please let		me see
Please let me			see this
Please let me see
	let me
	let me see
	let me see this
		me see this

Output 4

Please

think

this

season

most

fashionable

color

me.

N-grams

Please	think	this	season	most	fashionable	color	to	me.
Please		this		most			to

Sentence 413) BLEU: 0 (0.4/0.25/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (0.2/0/0/0)

Source

��

��y

�o��

��Y

��

�H

Ref 0

Can

you

change

the

lenses?

Ref 1

Can

you

give

new

lenses?

Ref 2

Can

ask

you

change

the

lenses?

Ref 3

Please

change

the

lenses.

Ref 4

Can

you

switch

lenses

for

me?

Ref 5

Would

you

able

change

the

lenses?

Ref 6

Could

you

swap

lenses?

Ref 7

Would

you

change

these

lenses

for

me,

please?

Ref 8

May

have

these

lenses

changed?

Ref 9

Could

get

these

lenses

changed?

Ref 10

Can

have

the

lenses

changed?

Ref 11

Could

get

lenses

replaced?

Ref 12

I'd

you

change

the

lenses.

Ref 13

Can

you

exchange

the

lenses?

Ref 14

Can

you

take

out

the

lenses

and

put

different

ones?

Ref 15

Can

you

insert

different

lenses?

Output 0

Can

Reform

this

lens?

N-grams

Can	I	Reform	this	lens?
Can	I
Can I

Output 1

can

transform

this

lens

N-grams

can

transform

this

lens

Output 2

can

transform

this

lens

it?

N-grams

I	can	transform	this	lens	it?
I

Output 3

Can

reform

this

lens?

N-grams

Can	I	reform	this	lens?
Can	I
Can I

Output 4

can

transform

this

lens?

N-grams

I	can	transform	this	lens?
I

Sentence 414) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.75/0.6667/0.5/0) ; 0.5081 (0.6667/0.6/0.5/0.3333) ; 0 (0.4/0/0/0)

Source

�O��

�O

�h��

�H

Ref 0

How

much

the

toll?

Ref 1

How

much

does

the

toll

cost?

Ref 2

How

much

for

the

toll?

Ref 3

What

the

toll?

Ref 4

What's

the

toll?

Ref 5

How

much

for

the

toll?

Ref 6

What's

the

fee?

Ref 7

What's

the

toll?

Ref 8

How

much

does

the

toll

cost?

Ref 9

What

the

toll

charge?

Ref 10

What's

the

toll

charge?

Ref 11

How

much

will

the

toll

cost

me?

Ref 12

What

the

cost

the

toll?

Ref 13

How

much

the

charge?

Ref 14

How

much

toll

charge?

Ref 15

How

much

the

toll

fee?

Output 0

How

much

it?

N-grams

How	much	is	it?
How	much	is
How much
How much is
	much is

Output 1

how

much

the

N-grams

how	much	is	the	?
	much	is	the
	much is
	much is the
		is the

Output 2

How

much

it?

N-grams

How	much	is	it?
How	much	is
How much
How much is
	much is

Output 3

How

much

the

expenses

N-grams

How	much	is	the	expenses	?
How	much	is	the
How much		is the
How much is
How much is the
	much is
	much is the

Output 4

How

many

are

the

expense?

N-grams

How	many	are	the	expense?
How			the

Sentence 415) BLEU: 0 (0.5/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0)

Source

�]�A

��\

��

�H

Ref 0

lunch

included?

Ref 1

lunch

part

it?

Ref 2

Does

come

with

lunch?

Ref 3

Does

that

include

lunch?

Ref 4

that

with

lunch?

Ref 5

Does

lunch

come

with

that?

Ref 6

that

including

lunch?

Ref 7

Would

lunch

included?

Ref 8

Does

that

include

lunch?

Ref 9

that

with

lunch?

Ref 10

lunch

provided?

Ref 11

Will

get

lunch

too?

Ref 12

Does

include

lunch?

Ref 13

Does

that

include

lunch?

Ref 14

Does

come

with

lunch?

Ref 15

Does

lunch

come

with

it?

Output 0

Include

lunch?

N-grams

Include	lunch?
	lunch?

Output 1

including

lunch

N-grams

including	lunch	?
including	lunch

Output 2

Including

lunch?

N-grams

Including	lunch?
	lunch?

Output 3

Include

lunch?

N-grams

Include	lunch?
	lunch?

Output 4

Including

lunch?

N-grams

Including	lunch?
	lunch?

Sentence 416) BLEU: 0.8633 (0.8889/0.875/0.8571/0.8333) ; 0 (0.5556/0.125/0/0) ; 0.8633 (0.8889/0.875/0.8571/0.8333) ; 0 (0.4545/0.3/0.1111/0) ; 0 (0.5/0.1429/0/0)

Source

��

�b

��

�o��

�@

�i

�o��

��

�a��

�H

Ref 0

Where

can

get

map

the

city?

Ref 1

Where

can

get

city

map?

Ref 2

Where

can

get

map

the

city?

Ref 3

you

know

where

can

get

map

the

city?

Ref 4

Where

could

obtain

street

map?

Ref 5

Where

could

find

street

map?

Ref 6

Where

would

able

get

hold

street

map?

Ref 7

From

where

could

get

city

map?

Ref 8

Where

would

find

city

map?

Ref 9

Where

are

maps

the

city

available?

Ref 10

Where

would

find

map

the

city?

Ref 11

Where

they

have

maps

the

city?

Ref 12

Where

could

get

map

the

city?

Ref 13

Where

can

get

city

map?

Ref 14

Where

are

city

maps

available?

Ref 15

Where

can

find

city

map?

Output 0

How

could

get

map

the

city?

N-grams

How	could	I	get	a	map	of	the	city?
	could	I	get	a	map	of	the	city?
	could I		get a		map of		the city?
	could I get			a map		of the
	could I get a				map of the
		I get		a map of
		I get a			map of the city?
		I get a map				of the city?
			get a map
			get a map of
				a map of the

Output 1

how

get

map

city

can

this

N-grams

how	i	get	map	of	city	can	this	?
		get	map	of	city	can
			map of

Output 2

How

could

get

map

the

city?

N-grams

How	could	I	get	a	map	of	the	city?
	could	I	get	a	map	of	the	city?
	could I		get a		map of		the city?
	could I get			a map		of the
	could I get a				map of the
		I get		a map of
		I get a			map of the city?
		I get a map				of the city?
			get a map
			get a map of
				a map of the

Output 3

Which

can

get

one

map

piece,

this

city,

at?

N-grams

Which	can	I	get	one	map	of	piece,	this	city,	at?
	can	I	get		map	of
	can I				map of
	can I get
		I get

Output 4

How

can

obtain

this

urban

map?

N-grams

How	can	I	in	obtain	this	urban	map?
	can	I		obtain			map?
	can I

Sentence 417) BLEU: 0 (0.6667/0.25/0.1429/0) ; 0 (0.6/0.5/0.3333/0) ; 1 (1/1/1/1) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.6667/0.25/0.1429/0)

Source

��

�O

��

�G

�Q

�@

��

�ͤ�

�C

Ref 0

Tomorrow

twenty-first

birthday.

Ref 1

twenty-first

birthday

tomorrow.

Ref 2

turn

twenty-one

tomorrow.

Ref 3

Tomorrow

will

turn

twenty-one.

Ref 4

Tomorrow

birthday

and

I'll

twenty-one.

Ref 5

It's

twenty-first

birthday

tomorrow.

Ref 6

Tomorrow's

birthday,

the

big

two

one.

Ref 7

Tomorrow

will

twenty-first

birthday.

Ref 8

It's

twenty-first

birthday

tomorrow.

Ref 9

twenty-first

birthday

tomorrow.

Ref 10

It's

twenty-first

birthday

tomorrow.

Ref 11

I'll

celebrate

twenty-first

birthday

tomorrow.

Ref 12

I'll

twenty-one

tomorrow.

Ref 13

Tomorrow

will

twenty

one

years

old.

Ref 14

Tomorrow

will

turn

twenty

one.

Ref 15

will

twenty

one

years

old

tomorrow.

Output 0

Tomorrow

will

two

ten

year-old

birthday.

N-grams

Tomorrow	will	be	an	I	two	ten	year-old	birthday.
Tomorrow	will	be		I	two			birthday.
Tomorrow will
Tomorrow will be
	will be

Output 1

tomorrow

birthday

N-grams

tomorrow	is	my	birthday	.
	is	my	birthday
	is my
	is my birthday
		my birthday

Output 2

Tomorrow

twenty-first

birthday.

N-grams

Tomorrow	is	my	twenty-first	birthday.
Tomorrow	is	my	twenty-first	birthday.
Tomorrow is		my twenty-first
Tomorrow is my			twenty-first birthday.
Tomorrow is my twenty-first
	is my
	is my twenty-first
	is my twenty-first birthday.
		my twenty-first birthday.

Output 3

Tomorrow

21-year-old

birthday.

N-grams

Tomorrow	is	my	21-year-old	birthday.
Tomorrow	is	my		birthday.
Tomorrow is
Tomorrow is my
	is my

Output 4

Tomorrow

will

two

ten

year-old

birthday.

N-grams

Tomorrow	will	be	an	I	two	ten	year-old	birthday.
Tomorrow	will	be		I	two			birthday.
Tomorrow will
Tomorrow will be
	will be

Sentence 418) BLEU: 0 (0.6875/0.06667/0/0) ; 0 (0.5625/0.1333/0.07143/0) ; 0 (0.5833/0.09091/0/0) ; 0 (0.6875/0.06667/0/0) ; 0 (0.5/0.06667/0/0)

Source

饻

��

�D��

�O

�@

��

�`

��

�D��

�A

�H

��

��w

�b

�̭�

�C

Ref 0

The

Japanese

bath

deep

bathtub

where

one

can

really

soak.

Ref 1

Japanese

bath

deep

and

you

can

really

soak

it.

Ref 2

You

can

really

soak

Japanese

bath

because

deep.

Ref 3

Japan

the

baths

are

deep

and

you

can

really

soak

them.

Ref 4

Japanese

bath

taken

deep

tub

which

you

can

enjoy

good

soak.

Ref 5

Japanese

bath

deep

tub

that

allows

you

have

thorough

soak.

Ref 6

Japanese

style

bath

deep

tub

that

lets

you

have

soak

that

you

can

feel

through

and

through.

Ref 7

People

can

really

immerse

themselves

Japanese

bath

since

the

tubs

are

deep.

Ref 8

Japanese

bathtubs

are

very

deep,

making

possible

really

submerge

oneself

them.

Ref 9

Japanese

bathtubs

are

deep,

and

comfortable

for

really

soaking

in.

Ref 10

The

Japanese

bathtub

deep

that

you

can

soak

well.

Ref 11

You

can

have

good

soak

Japanese

bathtubs

since

they

are

very

deep.

Ref 12

With

Japanese

bathtub

being

deep,

they're

great

soak

in.

Ref 13

The

Japanese

style

bath

deep

where

you

can

really

get

good

soak.

Ref 14

The

Japanese

style

bathtub

deep

you

can

really

immerse

yourself

properly.

Ref 15

The

Japanese

style

bathtub

deep

you

can

properly

cover

yourself

with

water.

Output 0

The

bathroom

Japan

very

deep

bathtub,

the

person

can

completely

soak

in.

N-grams

The

bathroom

Japan

very

deep

bathtub,

the

person

can

completely

soak

in.

The

Japan

very

deep

the

can

soak

in.

is a

Output 1

deep

bathtub

the

person

can

completely

inside

bathroom

japan

very

the

N-grams

deep

bathtub

the

person

can

completely

inside

bathroom

japan

very

the

deep

bathtub

the

can

very

a deep

a deep bathtub

deep bathtub

Output 2

Japanese

bathrooms

are

deep

bathtub,

soaking

the

person

can

completely

inside.

N-grams

Japanese	bathrooms	are	a	deep	bathtub,	soaking	the	person	can	completely	inside.
Japanese		are	a	deep		soaking	the		can
			a deep

Output 3

The

bathroom

Japan

very

deep

bathtub,

the

person

can

completely

soak

in.

N-grams

The

bathroom

Japan

very

deep

bathtub,

the

person

can

completely

soak

in.

The

Japan

very

deep

the

can

soak

in.

is a

Output 4

Japan's

bathroom

very

deep

bathtub,

the

human

can

��

the

complete

immersion

inside.

N-grams

Japan's

bathroom

very

deep

bathtub,

the

human

can

��

the

complete

immersion

inside.

very

deep

the

can

is a

Sentence 419) BLEU: 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�b

�y

��

�C

Ref 0

have

nose

bleed.

Ref 1

nose

bleeding.

Ref 2

have

bloody

nose.

Ref 3

have

got

nose

bleed.

Ref 4

nose

bleeding.

Ref 5

I've

got

nosebleed.

Ref 6

I'm

having

nosebleed.

Ref 7

I've

got

nose

bleed.

Ref 8

nose

bleeding.

Ref 9

I've

got

bloody

nose.

Ref 10

nose

bleeding.

Ref 11

Blood

coming

down

nose.

Ref 12

There's

blood

running

down

nose.

Ref 13

nose

bleeding.

Ref 14

I've

got

nose

bleed.

Ref 15

I've

got

blood

coming

from

nose.

Output 0

flowing

nosebleed.

N-grams

I	am	flowing	nosebleed.
I			nosebleed.

Output 1

nosebleed

N-grams

nosebleed

Output 2

I	nosebleeds.

N-grams

I	nosebleeds.
I

Output 3

flowing

nosebleed.

N-grams

I	am	flowing	nosebleed.
I			nosebleed.

Output 4

class

nosebleed.

N-grams

I	in	class	nosebleed.
I			nosebleed.

Sentence 420) BLEU: 0 (1/1/1/0) ; 0 (0.4/0/0/0) ; 0 (0.5/0/0/0) ; 0 (1/1/1/0) ; 0 (0.4/0/0/0)

Source

��

�i�H

��

�b

�o

��

�H

Ref 0

May

sit

here?

Ref 1

Can

sit

down

here?

Ref 2

you

mind

sit

here?

Ref 3

this

seat

taken?

Ref 4

take

seat

here?

Ref 5

Mind

sit

here?

Ref 6

sit

here?

Ref 7

alright

sit

here?

Ref 8

this

seat

taken?

Ref 9

Could

sit

here?

Ref 10

okay

sit

here.

Ref 11

Would

you

mind

sitting

here?

Ref 12

Would

okay

sat

here?

Ref 13

May

seated

here?

Ref 14

Would

you

mind

sat

here?

Ref 15

okay

sat

here?

Output 0

Can

sit

here?

N-grams

Can	I	sit	here?
Can	I	sit	here?
Can I		sit here?
Can I sit
	I sit
	I sit here?

Output 1

can

sit

this

N-grams

i	can	sit	this	?
		sit	this

Output 2

can

sit

this

it?

N-grams

I	can	sit	on	this	it?
I		sit		this

Output 3

Can

sit

here?

N-grams

Can	I	sit	here?
Can	I	sit	here?
Can I		sit here?
Can I sit
	I sit
	I sit here?

Output 4

may

sit

this?

N-grams

I	may	sit	in	this?
I		sit

Sentence 421) BLEU: 0 (0.75/0.2857/0/0) ; 0 (0.6667/0.25/0/0) ; 0 (0.5/0.2857/0/0) ; 0 (0.75/0.2857/0/0) ; 0 (0.4444/0.125/0/0)

Source

��

�i�D

��

�[�o��

�b

��

�a��

�C

Ref 0

Please

tell

where

gasoline

station

is.

Ref 1

Please

tell

how

get

gasoline

station.

Ref 2

Please

tell

where

the

gasoline

station

is.

Ref 3

Please

tell

where

can

find

gasoline

station.

Ref 4

Could

you

please

tell

where

there's

gas

station?

Ref 5

Could

you

please

tell

where

can

find

gas

station?

Ref 6

Would

you

mind

telling

where

there's

gas

station?

Ref 7

you

know

where

gas

station

is?

Ref 8

Where

would

find

gas

station?

Ref 9

I'd

know

where

gas

station

is,

please.

Ref 10

Tell

where

there

gasoline

station.

Ref 11

Where

can

find

gas

station?

Ref 12

I'd

know

where

there's

gas

station.

Ref 13

Please

tell

where

find

gas

station.

Ref 14

Where

gas

station

please?

Ref 15

Where

can

find

gas

station,

please?

Output 0

Give

tell

the

gas

station

where.

N-grams

Give	to	tell	me	the	gas	station	where.
	to	tell	me	the	gas	station
		tell me			gas station

Output 1

tell

gas

station

place

the

N-grams

to	tell	me	gas	station	in	place	the	.
to	tell	me	gas	station			the
	tell me		gas station

Output 2

tell

what

gas

station

place.

N-grams

To	tell	me	what	gas	station	in	place.
	tell	me		gas	station
	tell me			gas station

Output 3

Give

tell

the

gas

station

where.

N-grams

Give	to	tell	me	the	gas	station	where.
	to	tell	me	the	gas	station
		tell me			gas station

Output 4

For

tells

the

gas

station

any

place.

N-grams

For	tells	me	the	gas	station	in	any	place.
		me	the	gas	station
				gas station

Sentence 422) BLEU: 0.4671 (0.8889/0.75/0.4286/0.1667) ; 0 (0.7778/0.375/0.1429/0) ; 0.4671 (0.8889/0.75/0.4286/0.1667) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.6667/0.125/0/0)

Source

��n

�ѰO

��

��q��

�C

Ref 0

Don't

forget

call

tomorrow.

Ref 1

Please

remember

call

tomorrow.

Ref 2

Tomorrow

please

remember

call

me.

Ref 3

Don't

forget

call

tomorrow.

Ref 4

Call

tomorrow

and

don't

forget.

Ref 5

Don't

forget

phone

tomorrow.

Ref 6

sure

give

jingle

tomorrow.

Ref 7

Please

remember

call

tomorrow.

Ref 8

sure

that

you

don't

forget

call

tomorrow.

Ref 9

You

must

not

forget

call

tomorrow.

Ref 10

Remember

call

tomorrow.

Ref 11

Please

call

tomorrow

without

fail.

Ref 12

Tomorrow

you

mustn't

forget

call

me.

Ref 13

Don't

forget

ring

tomorrow.

Ref 14

Please

not

neglect

call

tomorrow.

Ref 15

Please

remember

call

tomorrow.

Output 0

not

forget

give

call

tomorrow.

N-grams

Do	not	forget	to	give	me	a	call	tomorrow.
	not	forget	to	give	me	a	call	tomorrow.
	not forget		to give		me a		call tomorrow.
	not forget to			give me
		forget to		give me a
			to give me
			to give me a

Output 1

not

forget

call

tomorrow

will

N-grams

do	not	forget	to	me	call	tomorrow	will	.
do	not	forget	to	me	call	tomorrow
do not		forget to
	not forget
	not forget to

Output 2

not

forget

give

call

tomorrow.

N-grams

Do	not	forget	to	give	me	a	call	tomorrow.
	not	forget	to	give	me	a	call	tomorrow.
	not forget		to give		me a		call tomorrow.
	not forget to			give me
		forget to		give me a
			to give me
			to give me a

Output 3

Don't

the

forgetting

will

call

tomorrow.

N-grams

Don't	the	forgetting	will	call	me	tomorrow.
Don't				call	me	tomorrow.
				call me
				call me tomorrow.
					me tomorrow.

Output 4

not

forget

that

tomorrow

will

telephone

me.

N-grams

Do	not	forget	that	tomorrow	will	telephone	to	me.
	not	forget	that	tomorrow			to	me.
	not forget

Sentence 423) BLEU: 0.4347 (0.6/0.5556/0.375/0.2857) ; 0 (0.5/0.2857/0.1667/0) ; 0.4347 (0.6/0.5556/0.375/0.2857) ; 0 (0.4444/0.25/0/0) ; 0 (0.3333/0.25/0.1429/0)

Source

�A

��

�a

��

�w

��

�H

Ref 0

Would

you

take

the

police,

please?

Ref 1

Please

take

the

police.

Ref 2

Would

you

please

take

the

police.

Ref 3

Please

take

the

police

station.

Ref 4

Could

you

please

escort

the

police?

Ref 5

Would

you

help

the

police,

please?

Ref 6

Can

you

please

take

the

police?

Ref 7

Could

you

please

take

the

police?

Ref 8

Would

you

mind

taking

the

police?

Ref 9

Please

take

the

police.

Ref 10

Please

take

the

police.

Ref 11

Would

you

mind

talking

the

police.

Ref 12

Could

you

escort

the

police.

Ref 13

Would

you

show

the

police

station,

please?

Ref 14

Would

you

take

the

local

authorities,

please?

Ref 15

Would

you

take

the

law

enforcement

office,

please?

Output 0

Can

you

take

the

public

security

departments

it?

N-grams

Can	you	take	me	to	the	public	security	departments	it?
Can	you	take	me	to	the
Can you		take me		to the
	you take		me to
	you take me
	you take me to
		take me to
		take me to the
			me to the

Output 1

can

you

the

public

security

N-grams

can	you	me	to	the	public	security	?
	you	me	to	the
		me to
		me to the
			to the

Output 2

Can

you

take

the

public

security

departments

it?

N-grams

Can	you	take	me	to	the	public	security	departments	it?
Can	you	take	me	to	the
Can you		take me		to the
	you take		me to
	you take me
	you take me to
		take me to
		take me to the
			me to the

Output 3

Can

you

bring

public

security

official's

section?

N-grams

Can	you	bring	me	to	public	security	official's	section?
Can	you		me	to
Can you			me to

Output 4

You

can

lead

the

Public

security

department?

N-grams

You	can	lead	me	to	the	Public	security	department?
			me	to	the
			me to
			me to the
				to the

Sentence 424) BLEU: 0 (0.5/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.5/0/0/0)

Source

�A

�ݭn

��

�H

Ref 0

you

need

deposit?

Ref 1

need

make

deposit?

Ref 2

need

make

payment

beforehand?

Ref 3

payment

beforehand

necessary?

Ref 4

deposit

necessary?

Ref 5

Will

you

want

deposit?

Ref 6

Will

deposit

required?

Ref 7

Will

deposit

necessary?

Ref 8

necessary

give

you

deposit?

Ref 9

Would

you

require

deposit?

Ref 10

deposit

necessary?

Ref 11

Must

leave

you

deposit?

Ref 12

deposit

needed?

Ref 13

deposit

required?

Ref 14

need

pay

advance?

Ref 15

need

pay

deposit?

Output 0

You

need

the

deposit?

N-grams

You	need	the	deposit?
	need		deposit?

Output 1

you

need

deposit

N-grams

you	need	deposit	?
you	need	deposit
you need

Output 2

You

need

deposit

it?

N-grams

You	need	to	deposit	it?
	need	to	deposit
	need to

Output 3

you

need

security

deposit?

N-grams

Do	you	need	security	deposit?
Do	you	need		deposit?
Do you
Do you need
	you need

Output 4

You

need

the

deposit?

N-grams

You	need	the	deposit?
	need		deposit?

Sentence 425) BLEU: 0 (1/0.5/0/0) ; 0 (0.5/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.8/0/0/0) ; 0 (1/0.5/0/0)

Source

��

�ֻ�

�C

Ref 0

express,

please.

Ref 1

Please

send

express.

Ref 2

Please

express

me.

Ref 3

Express,

please.

Ref 4

Express

mail,

please.

Ref 5

express

delivery,

please.

Ref 6

I'd

express

mail,

please.

Ref 7

Express

mail,

please.

Ref 8

Ship

express,

please.

Ref 9

I'd

sent

express

mail,

please.

Ref 10

I'd

you

send

this

delivery.

Ref 11

Send

this

express.

Ref 12

I'd

you

use

express.

Ref 13

would

express

post,

please.

Ref 14

would

mail

express,

please.

Ref 15

express

service,

please.

Output 0

Please

use

express.

N-grams

Please	use	express.
Please	use	express.
	use express.

Output 1

please

use

express

N-grams

please	use	express	.
	use	express

Output 2

Please

use

courier.

N-grams

Please	use	courier.
Please	use

Output 3

Please

use

express

delivery.

N-grams

Please	use	an	express	delivery.
Please	use		express	delivery.

Output 4

Please

use

express.

N-grams

Please	use	express.
Please	use	express.
	use express.

Sentence 426) BLEU: 0.3508 (0.4545/0.4/0.3333/0.25) ; 0 (0.6/0/0/0) ; 0.3508 (0.4545/0.4/0.3333/0.25) ; 0 (0.6667/0.2/0/0) ; 0 (0.5714/0/0/0)

Source

��

�_��

�j�h��

�y��

��

�Q

�e

�F

�C

Ref 0

Looks

most

the

seats

are

occupied.

Ref 1

looks

most

the

seats

are

occupied.

Ref 2

Most

the

seats

look

full.

Ref 3

Most

the

seats

look

they

are

occupied.

Ref 4

Looks

most

the

seats

are

taken.

Ref 5

Most

the

seats

appear

use.

Ref 6

Most

the

seats

seem

occupied.

Ref 7

seems

though

most

seats

are

taken.

Ref 8

think

that

the

seats

are

just

about

sold

out.

Ref 9

Most

the

seats

seem

gone.

Ref 10

doesn't

look

there

are

many

seats

available.

Ref 11

There

don't

seem

any

seats

available.

Ref 12

Almost

all

the

seats

seem

full.

Ref 13

Appears

that

most

the

seats

are

full.

Ref 14

Seems

most

the

seats

are

taken.

Ref 15

Looks

almost

all

the

seats

are

taken.

Output 0

The

majority

the

seats

appear

have

been

accounted

for.

N-grams

The	majority	of	the	seats	appear	to	have	been	accounted	for.
		of	the	seats	appear	to
		of the		seats appear
		of the seats			appear to
		of the seats appear
			the seats
			the seats appear
			the seats appear to
				seats appear to

Output 1

the

majority

seats

N-grams

the	majority	seats	to	.
the		seats	to

Output 2

The

majority

the

seats

appear

have

been

accounted

for.

N-grams

The	majority	of	the	seats	appear	to	have	been	accounted	for.
		of	the	seats	appear	to
		of the		seats appear
		of the seats			appear to
		of the seats appear
			the seats
			the seats appear
			the seats appear to
				seats appear to

Output 3

Look

most

seats

being

all

occupied.

N-grams

Look	most	seats	being	all	occupied.
	most	seats		all	occupied.
	most seats

Output 4

Looked

the

majority

seats

occupy.

N-grams

Looked	like	the	majority	seats	to	occupy.
	like	the		seats	to

Sentence 427) BLEU: 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0)

Source

��M

�C

Ref 0

Sure.

Ref 1

OK.

Ref 2

Alright.

Ref 3

Certainly.

Ref 4

OK.

Ref 5

Fine.

Ref 6

All

right.

Ref 7

Certainly.

Ref 8

course.

Ref 9

problem.

Ref 10

see.

Ref 11

Certainly.

Ref 12

I	understand.

Ref 13

huh.

Ref 14

Okay.

Ref 15

Yes.

Output 0

Certainly.

N-grams

Certainly.

Output 1

certainly

N-grams

certainly

Output 2

當然.

N-grams

當然.

Output 3

Certainly.

N-grams

Certainly.

Output 4

Certainly.

N-grams

Certainly.

Sentence 428) BLEU: 0 (0.8333/0.2/0/0) ; 0 (0.8333/0/0/0) ; 0 (0.8333/0.2/0/0) ; 0 (0.7143/0.1667/0/0) ; 0 (1/0.5/0/0)

Source

��~

��

�y��

��

�C

Ref 0

Yellow

very

popular

this

year.

Ref 1

This

year

yellow

popular.

Ref 2

Yellow

fashion

this

year.

Ref 3

Yellow

this

year.

Ref 4

Yellow

this

year.

Ref 5

Yellow

the

hot

color

this

year.

Ref 6

This

year

yellow

big.

Ref 7

This

year,

yellow

very

popular.

Ref 8

Yellow

the

rage

this

year.

Ref 9

Yellow

very

"in"

this

year.

Ref 10

Yellow

really

this

year.

Ref 11

This

year's

most

popular

color

yellow.

Ref 12

Yellow

very

trendy

color

this

year.

Ref 13

Yellow

fashion

this

year.

Ref 14

Yellow

very

trendy

this

year.

Ref 15

Yellow

the

color

this

year.

Output 0

This

year,

popular

yellow.

N-grams

This	year,	it	is	popular	yellow.
This	year,		is	popular	yellow.
This year,

Output 1

this

year

popular

yellow

very

N-grams

this	year	popular	yellow	very	.
this	year	popular	yellow	very

Output 2

This

year,

popular

yellow.

N-grams

This	year,	it	is	popular	yellow.
This	year,		is	popular	yellow.
This year,

Output 3

Spread

yellow

very

much

this

year.

N-grams

Spread	a	yellow	very	much	this	year.
	a	yellow	very		this	year.
					this year.

Output 4

This

year

very

popular

yellow.

N-grams

This	year	very	popular	yellow.
This	year	very	popular	yellow.
This year		very popular

Sentence 429) BLEU: 0 (0.875/0.5714/0.3333/0) ; 0 (0.4286/0.1667/0/0) ; 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.875/0.5714/0.3333/0) ; 0 (0.6667/0.375/0.1429/0)

Source

��

�a

��

�h

��

�C

Ref 0

Please

take

the

hospital.

Ref 1

Take

the

hospital,

please.

Ref 2

Please

drive

the

hospital.

Ref 3

Please

give

lift

the

hospital.

Ref 4

Please

escort

the

hospital.

Ref 5

Please

see

the

hospital.

Ref 6

Please

get

hospital.

Ref 7

Would

you

bring

the

hospital,

please?

Ref 8

want

taken

the

hospital.

Ref 9

Could

you

take

the

hospital?

Ref 10

The

hospital,

please.

Ref 11

Would

you

mind

taking

the

hospital?

Ref 12

Could

you

take

the

hospital?

Ref 13

Please

get

the

hospital.

Ref 14

Please

escort

the

hospital.

Ref 15

would

taken

the

hospital.

Output 0

Please

bring

hospital.

N-grams

Please	bring	me	to	go	to	a	hospital.
Please	bring	me	to		to	a	hospital.
	bring me				to a
	bring me to				to a hospital.
		me to				a hospital.

Output 1

please

hospital

N-grams

please	me	to	hospital	go	to	.
	me	to			to
	me to

Output 2

Please

take

hospital.

N-grams

Please	take	me	to	hospital.
Please	take	me	to	hospital.
Please take		me to
Please take me
Please take me to
	take me
	take me to

Output 3

Please

bring

hospital.

N-grams

Please	bring	me	to	go	to	a	hospital.
Please	bring	me	to		to	a	hospital.
	bring me				to a
	bring me to				to a hospital.
		me to				a hospital.

Output 4

Invites

lead

the

hospital.

N-grams

Invites	to	lead	me	to	go	to	the	hospital.
	to		me	to		to the		hospital.
			me to			to the hospital.
							the
							the hospital.

Sentence 430) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.5/0.2/0/0)

Source

�

�A

��

�{�b

��

�C

Ref 0

No,

I'm

not

hurry.

Ref 1

No,

I'm

hurry.

Ref 2

No,

I'm

not

rush.

Ref 3

No,

I'm

not

any

hurry.

Ref 4

No,

it's

rush.

Ref 5

No,

there's

hurry.

Ref 6

No,

it's

not

rush.

Ref 7

No,

it's

not

rush.

Ref 8

No,

you

don't

need

hurry.

Ref 9

No,

it's

hurry.

Ref 10

It's

okay,

not

rush.

Ref 11

It's

fine,

don't

have

rush.

Ref 12

problem,

don't

have

hurry.

Ref 13

No,

I'm

not

rush.

Ref 14

No,

rush.

Ref 15

No,

please

take

your

time.

Output 0

No,

I'm

busy

now.

N-grams

No,	I'm	busy	now.
No,	I'm
No, I'm

Output 1

busy

now

very

N-grams

no	,	i	busy	now	am	very	.
no					am

Output 2

No,

I'm

busy

now.

N-grams

No,	I'm	busy	now.
No,	I'm
No, I'm

Output 3

Not,

very

busy

now.

N-grams

Not,	I	am	very	busy	now.
	I	am
	I am

Output 4

No,

very

now

busy.

N-grams

No,	I	am	very	now	busy.
No,	I	am
	I am

Sentence 431) BLEU: 1 (1/1/1/1) ; 0 (0.4/0/0/0) ; 1 (1/1/1/1) ; 0 (0.4/0.25/0/0) ; 1 (1/1/1/1)

Source

�o

�O

��

�C

Ref 0

This

Mr.

Yamada.

Ref 1

There

here

Mr.

Yamada.

Ref 2

Let

introduce

you

Mr.

Yamada.

Ref 3

I'd

introduce

you

Mr.

Yamada.

Ref 4

This

gentleman

Mr.

Yamada.

Ref 5

And

this

would

Mr.

Yamada.

Ref 6

And

here

have

Mr.

Yamada.

Ref 7

I'd

introduce

you

Mr.

Yamada.

Ref 8

Please

meet

Mr.

Yamada.

Ref 9

This

would

Mr.

Yamada.

Ref 10

I'd

introduce

Mr.

Yamada.

Ref 11

Please

meet

Mr.

Yamada.

Ref 12

Allow

introduce

you

Mr.

Yamada.

Ref 13

this

side

Mr.

Yamada,

Ref 14

Here

Mr.

Yamada.

Ref 15

May

introduce

Mr.

Yamada.

Output 0

This

Mr.

Yamada.

N-grams

This	is	Mr.	Yamada.
This	is	Mr.	Yamada.
This is		Mr. Yamada.
This is Mr.
This is Mr. Yamada.
	is Mr.
	is Mr. Yamada.

Output 1

this

mr.

yamada

N-grams

this	is	mr.	yamada	.
this	is

Output 2

This

Mr.

Yamada.

N-grams

This	is	Mr.	Yamada.
This	is	Mr.	Yamada.
This is		Mr. Yamada.
This is Mr.
This is Mr. Yamada.
	is Mr.
	is Mr. Yamada.

Output 3

This

the

��

Sir.

N-grams

This	is	the	��	Sir.
This	is
This is

Output 4

This

Mr.

Yamada.

N-grams

This	is	Mr.	Yamada.
This	is	Mr.	Yamada.
This is		Mr. Yamada.
This is Mr.
This is Mr. Yamada.
	is Mr.
	is Mr. Yamada.

Sentence 432) BLEU: 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.6/0.25/0/0) ; 0.6687 (0.8/0.75/0.6667/0.5) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.6/0.5/0.3333/0)

Source

��

�Q

�n

�@

��

�L�S

��

�W��

�C

Ref 0

I'd

sleeveless

sweater.

Ref 1

I'm

looking

for

sleeveless

sweater.

Ref 2

sweater

without

sleeves

what

I'm

looking

for.

Ref 3

I'd

buy

sleeveless

sweater.

Ref 4

want

sweater

with

sleeves.

Ref 5

I'd

sweater

vest.

Ref 6

I'm

hoping

find

sweater

vest.

Ref 7

want

get

sleeveless

sweater.

Ref 8

I'm

looking

for

sleeveless

sweater.

Ref 9

I'm

interested

getting

sleeveless

sweater.

Ref 10

looking

for

sweater

without

sleeves.

Ref 11

want

sweater

with

sleeves.

Ref 12

I'd

buy

sleeveless.

Ref 13

would

sweater

that

doesn't

have

sleeves.

Ref 14

would

sweater

vest.

Ref 15

looking

for

sweater

with

sleeves.

Output 0

I'd

sleeveless

T-shirt.

N-grams

I'd	like	a	sleeveless	T-shirt.
I'd	like	a	sleeveless
I'd like		a sleeveless
I'd like a
I'd like a sleeveless
	like a
	like a sleeveless

Output 1

sleeveless

want

N-grams

i	a	sleeveless	want	.
	a	sleeveless	want
	a sleeveless

Output 2

I'd

sleeveless

T-shirt.

N-grams

I'd	like	a	sleeveless	T-shirt.
I'd	like	a	sleeveless
I'd like		a sleeveless
I'd like a
I'd like a sleeveless
	like a
	like a sleeveless

Output 3

want

blouse

sleeveless.

N-grams

I	want	a	blouse	of	sleeveless.
I	want	a			sleeveless.
I want
I want a
	want a

Output 4

want

non-sleeve's

coat.

N-grams

I	want	a	non-sleeve's	coat.
I	want	a
I want
I want a
	want a

Sentence 433) BLEU: 0.3303 (0.6667/0.375/0.2857/0.1667) ; 0 (0.5556/0.25/0/0) ; 0.3303 (0.6667/0.375/0.2857/0.1667) ; 0 (0.3333/0.125/0/0) ; 0 (0.6667/0.1818/0/0)

Source

�n

�h

��

�b

��

�U

�H

Ref 0

Which

station

get

off

Central

Park?

Ref 1

get

Central

Park,

which

station

get

off

at?

Ref 2

Which

station

for

Central

Park?

Ref 3

What

station

get

off

for

Central

Park?

Ref 4

want

Central

Park,

what

station

get

off

at?

Ref 5

Central

Park,

what

the

station

where

get

off?

Ref 6

When

Central

Park,

what

station

disembark

at?

Ref 7

For

Central

Park,

which

station

get

off

at?

Ref 8

What

station

should

get

off

at,

want

Central

Park?

Ref 9

When

going

Central

Park,

which

the

station

get

off

at?

Ref 10

Which

station

should

get

off

Central

Park?

Ref 11

Which

station

for

Central

Park?

Ref 12

What's

the

station

where

need

get

Central

Park?

Ref 13

Which

station

get

off

the

train

order

Central

Park?

Ref 14

order

Central

Park,

which

station

the

best

get

out

at?

Ref 15

What

station

the

best

use

want

Central

Park.

Output 0

Central

Park

where

the

station?

N-grams

I	go	to	Central	Park	where	the	next	station?
I	go	to	Central		where	the
I go		to Central
I go to
I go to Central
	go to
	go to Central

Output 1

central

park

the

station

which

N-grams

i	go	to	central	park	the	station	which	?
	go	to			the	station	which
	go to				the station

Output 2

Central

Park

where

the

station?

N-grams

I	go	to	Central	Park	where	the	next	station?
I	go	to	Central		where	the
I go		to Central
I go to
I go to Central
	go to
	go to Central

Output 3

Want

central

park

which

stand

under?

N-grams

Want	to	go	central	park	me	which	stand	under?
	to	go				which
	to go

Output 4

Which

station

can

the

central

park

at?

N-grams

Which	station	can	go	to	the	central	park	I	to	be	at?
Which	station		go	to	the			I	to		at?
Which station			go to

Sentence 434) BLEU: 0 (0.625/0.2857/0.1667/0) ; 0 (0.6667/0.4/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.625/0.2857/0.1667/0) ; 0 (0.8333/0.4/0/0)

Source

��

�}

�ݭn

�伵

�C

Ref 0

arch

needs

support.

Ref 1

need

support

for

arch.

Ref 2

The

arch

feet

needs

supported.

Ref 3

need

give

support

arch.

Ref 4

need

support

for

arch.

Ref 5

have

support

for

arch.

Ref 6

arch

requires

some

support.

Ref 7

need

arch

support.

Ref 8

It's

necessary

for

have

some

arch

support.

Ref 9

Arch

support

necessity

for

me.

Ref 10

need

something

support

arch.

Ref 11

you

have

anything

which

would

support

arch?

Ref 12

need

arch

support.

Ref 13

need

arch

support.

Ref 14

foot

requires

arch

support.

Ref 15

need

shoes

that

give

arch

support.

Output 0

feet

bow

needs

propped

up.

N-grams

My	feet	bow	needs	to	be	propped	up.
My	feet		needs	to	be
			needs to
			needs to be
				to be

Output 1

support

bow

needs

N-grams

support	my	bow	needs	to	.
support	my		needs	to
support my			needs to

Output 2

I腳弓the

necessary

support.

N-grams

I腳弓the	necessary	support.
	necessary	support.

Output 3

feet

bow

needs

propped

up.

N-grams

My	feet	bow	needs	to	be	propped	up.
My	feet		needs	to	be
			needs to
			needs to be
				to be

Output 4

foot

bow

needs

support.

N-grams

My	foot	bow	needs	to	support.
My	foot		needs	to	support.
My foot			needs to

Sentence 435) BLEU: 0.5373 (0.8333/0.6/0.5/0.3333) ; 0 (0.3333/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.2/0/0/0) ; 0.5373 (0.8333/0.6/0.5/0.3333)

Source

��

�o��

�F

�@�_

��q

�ƬG

�C

Ref 0

There's

been

traffic

accident.

Ref 1

There

was

traffic

accident.

Ref 2

traffic

accident

occurred.

Ref 3

There

was

accident.

Ref 4

traffic

accident

has

occurred.

Ref 5

traffic

accident

has

happened.

Ref 6

There

has

been

car

accident.

Ref 7

traffic

accident

has

taken

place.

Ref 8

There's

traffic

accident.

Ref 9

Someone's

had

traffic

accident.

Ref 10

car

accident

occurred.

Ref 11

There

was

car

accident.

Ref 12

car

accident

happened.

Ref 13

There's

been

car

accident.

Ref 14

There

has

been

car

crash.

Ref 15

There

has

been

collision.

Output 0

That

has

had

traffic

accident.

N-grams

That	has	had	a	traffic	accident.
	has	had	a	traffic	accident.
		had a		traffic accident.
		had a traffic
		had a traffic accident.
			a traffic
			a traffic accident.

Output 1

that

accident

N-grams

that	accident	.
	accident

Output 2

That

the

accident

happened.

N-grams

That	the	accident	happened.
		accident	happened.
		accident happened.

Output 3

That

took

place

transportation

accident.

N-grams

That	took	place	transportation	accident.
				accident.

Output 4

That

has

had

traffic

accident.

N-grams

That	has	had	a	traffic	accident.
	has	had	a	traffic	accident.
		had a		traffic accident.
		had a traffic
		had a traffic accident.
			a traffic
			a traffic accident.

Sentence 436) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.4/0/0/0) ; 0 (0.8333/0.4/0.25/0) ; 0 (0.6/0/0/0)

Source

��

�t��

��

�ݰT�B

�C

Ref 0

Ask

over

there

information,

please.

Ref 1

Please

ask

over

there

information.

Ref 2

Please

ask

the

information

desk

over

there.

Ref 3

Please

the

information

desk

over

there

and

ask.

Ref 4

Please

ask

the

information

counter,

over

there.

Ref 5

Please

inquire

the

information

booth

over

there.

Ref 6

Please

check

with

information,

over

that

way.

Ref 7

Please

ask

over

there

information.

Ref 8

Would

you

ask

over

information?

Ref 9

You

should

ask

there

information.

Ref 10

Please

ask

information

over

there.

Ref 11

Please

the

information

desk.

Ref 12

You

can

inquire

over

information

desk.

Ref 13

Please

ask

over

there

the

information

desk.

Ref 14

Please

inquire

over

there

the

information

desk.

Ref 15

Please

make

your

inquiries

over

there

the

information

desk.

Output 0

Please

where

the

information

desk.

N-grams

Please	where	the	information	desk.
Please		the	information	desk.
		the information
		the information desk.
			information desk.

Output 1

please

the

information

desk

consult

there

N-grams

please	the	information	desk	consult	there	.
	the	information	desk		there
	the information
	the information desk
		information desk

Output 2

Please

where

the

Information

Desk.

N-grams

Please	where	the	Information	Desk.
Please		the

Output 3

Please

consult

the

information

desk

there.

N-grams

Please	consult	the	information	desk	there.
Please		the	information	desk	there.
		the information
		the information desk
			information desk

Output 4

Please

consult

there

information

office.

N-grams

Please	consult	there	information	office.
Please		there	information

Sentence 437) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.5/0.2/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (1/0.75/0.3333/0) ; 0 (1/0.75/0.3333/0)

Source

�A

��

�ɭ�

�^��

�H

Ref 0

What

time

will

you

return?

Ref 1

What

time

will

you

come

back?

Ref 2

What

time

will

you

get

back?

Ref 3

When

will

you

coming

back?

Ref 4

What

time

will

you

back?

Ref 5

What

time

will

you

come

back?

Ref 6

What

time

you

expect

return?

Ref 7

When

will

you

coming

back?

Ref 8

When

are

you

scheduled

back?

Ref 9

What

time

are

you

due

back?

Ref 10

What

time

will

you

back?

Ref 11

When

are

you

due

return?

Ref 12

What's

your

planned

return

time?

Ref 13

What

time

will

you

come

back?

Ref 14

What

time

are

you

going

come

back?

Ref 15

What

time

are

you

expecting

back?

Output 0

When

did

you

come

back?

N-grams

When	did	you	come	back?
When		you	come	back?
		you come
		you come back?
			come back?

Output 1

when

you

come

back

N-grams

when	you	come	back	do	?
	you	come		do
	you come

Output 2

When

did

you

come

back?

N-grams

When	did	you	come	back?
When		you	come	back?
		you come
		you come back?
			come back?

Output 3

When

you

come

back?

N-grams

When	do	you	come	back?
When	do	you	come	back?
	do you		come back?
		you come
		you come back?

Output 4

When

you

come

back?

N-grams

When	do	you	come	back?
When	do	you	come	back?
	do you		come back?
		you come
		you come back?

Sentence 438) BLEU: 0 (0.6667/0.5/0/0) ; 0 (0.25/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.25/0/0/0)

Source

��

��O

��

�H

Ref 0

Can

charge

it?

Ref 1

Can

pay

card?

Ref 2

Can

charge

credit

card?

Ref 3

Can

pay

using

credit

card?

Ref 4

Can

put

card?

Ref 5

Can

pay

card?

Ref 6

Card

OK?

Ref 7

Could

put

card?

Ref 8

May

pay

for

with

card?

Ref 9

you

payment

credit

card?

Ref 10

May

use

card?

Ref 11

okay

use

card?

Ref 12

possible

use

card?

Ref 13

May

use

credit

card?

Ref 14

May

charge

credit

card?

Ref 15

Can

use

charge

card?

Output 0

Can

charge?

N-grams

Can	I	charge?
Can	I
Can I

Output 1

can

charge

N-grams

i	can	charge	?
		charge

Output 2

can

charge?

N-grams

I	can	charge?
I

Output 3

Can

charge?

N-grams

Can	I	charge?
Can	I
Can I

Output 4

can

collect

fees?

N-grams

I	can	collect	fees?
I

Sentence 439) BLEU: 0 (1/1/1/0) ; 0 (0.6/0.25/0/0) ; 0 (1/1/1/0) ; 0 (1/1/1/0) ; 0 (0.75/0.3333/0/0)

Source

��

�F

�C

Ref 0

It's

too

tight.

Ref 1

This

too

tight.

Ref 2

This

too

small.

Ref 3

It's

too

small.

Ref 4

It's

pinching.

Ref 5

feels

too

tight.

Ref 6

It's

way

too

tight.

Ref 7

think

it's

too

tight.

Ref 8

feels

too

snug.

Ref 9

doesn't

fit

well

Ref 10

It's

too

small.

Ref 11

feel

it's

too

tight.

Ref 12

It's

bit

the

tight

side.

Ref 13

too

small.

Ref 14

fits

too

tightly.

Ref 15

too

snug.

Output 0

too

tight.

N-grams

It	is	too	tight.
It	is	too	tight.
It is		too tight.
It is too
	is too
	is too tight.

Output 1

too

tight

N-grams

it	is	too	tight	.
	is	too	tight
	is too

Output 2

too

tight.

N-grams

It	is	too	tight.
It	is	too	tight.
It is		too tight.
It is too
	is too
	is too tight.

Output 3

too

tight.

N-grams

It	is	too	tight.
It	is	too	tight.
It is		too tight.
It is too
	is too
	is too tight.

Output 4

was

too

tight.

N-grams

It	was	too	tight.
It		too	tight.
		too tight.

Sentence 440) BLEU: 0 (0.8/0.4444/0.125/0) ; 0 (0.6/0.1111/0/0) ; 0 (0.8/0.4444/0.125/0) ; 0.2597 (0.5455/0.3/0.2222/0.125) ; 0 (0.4167/0.09091/0/0)

Source

��

�b

��

�R

�@

�i

�f��

��

�H

Ref 0

Where

can

buy

one-day

lift

ticket?

Ref 1

Where

can

one-day

lift

ticket

bought?

Ref 2

Where

can

get

lift

ticket

for

one-day?

Ref 3

Where

are

the

one-day

lift

tickets

sold?

Ref 4

Where

can

get

lift

ticket

for

the

day?

Ref 5

Where

can

purchase

one-day

lift

ticket?

Ref 6

Where

could

get

hold

lift

ticket

for

the

day?

Ref 7

Where

purchase

one-day

lift

pass?

Ref 8

Where

are

one-day

lift

tickets

sold?

Ref 9

Where

may

purchase

one-day

lift

ticket?

Ref 10

Where

would

able

purchase

one-day

lift

ticket?

Ref 11

Could

you

tell

where

can

get

one-day

ticket

for

the

lift?

Ref 12

Where

are

the

one-day

ticket

for

the

lift

sold?

Ref 13

Where

can

purchase

one

day

lift

pass.

Ref 14

Where

can

get

one

day

lift

pass.

Ref 15

Where

can

get

lift

pass

for

one

day.

Output 0

How

could

buy

ticket

ride

the

day?

N-grams

How	could	I	buy	a	ticket	ride	of	the	day?
	could	I	buy	a	ticket		of	the	day?
	could I		buy a					the day?
		I buy
		I buy a

Output 1

how

buy

ticket

the

day

which

can

N-grams

how	i	buy	a	ticket	the	day	which	can	?
		buy	a	ticket	the	day		can
		buy a

Output 2

How

could

buy

ticket

ride

the

day?

N-grams

How	could	I	buy	a	ticket	ride	of	the	day?
	could	I	buy	a	ticket		of	the	day?
	could I		buy a					the day?
		I buy
		I buy a

Output 3

Which

can

buy

day

ticket

that

takes

bus

at?

N-grams

Which	can	I	buy	a	day	ticket	that	takes	bus	at?
	can	I	buy	a	day	ticket
	can I		buy a
	can I buy
	can I buy a
		I buy
		I buy a

Output 4

How

can

buy

the

date

ticket

which

travels

vehicle?

N-grams

How	can	I	in	buy	the	date	ticket	which	travels	by	vehicle?
	can	I		buy	the		ticket
	can I

Sentence 441) BLEU: 0 (0.3333/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.5/0.3333/0/0)

Source

�ԶE��

�b

��

�H

Ref 0

Where

the

waiting

room?

Ref 1

Where

the

waiting

room

located?

Ref 2

Where

can

find

the

waiting

room?

Ref 3

Where

the

lounge?

Ref 4

Where

would

the

waiting

room

be?

Ref 5

Where

would

find

the

waiting

room?

Ref 6

Where

would

the

waiting

room

located?

Ref 7

Could

you

direct

the

waiting

room?

Ref 8

Whereabouts

the

waiting

room?

Ref 9

Where

can

find

the

waiting

room?

Ref 10

Could

you

show

where

the

waiting

room

is?

Ref 11

Where

can

find

the

waiting

room?

Ref 12

The

waiting

room,

please.

Ref 13

Where

the

waiting

area?

Ref 14

Where

the

area

for

waiting?

Ref 15

Where

the

lobby

for

waiting?

Output 0

Waiting

room

where?

N-grams

Waiting	room	where?
	room

Output 1

waiting

room

N-grams

waiting	room	?
waiting	room
waiting room

Output 2

Waiting

room

where?

N-grams

Waiting	room	where?
	room

Output 3

Wait

diagnose

room

which?

N-grams

Wait	to	diagnose	room	which?
	to		room

Output 4

Hospital

waiting

room

in?

N-grams

Hospital	waiting	room	in?
	waiting	room
	waiting room

Sentence 442) BLEU: 0 (0.3333/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0)

Source

�r�p��

�A

��

�b

�o

��

�H

Ref 0

Driver,

can

you

stop

there?

Ref 1

Driver.

Can

you

stop

the

car

over

there?

Ref 2

Driver.

Please

stop

the

car

over

there.

Ref 3

Driver.

Please

let

off

over

there.

Ref 4

Driver,

could

you

make

stop

over

there?

Ref 5

Driver,

would

you

please

pull

over

there?

Ref 6

Make

stop

over

there,

would

you

please?

Ref 7

Excuse

me,

driver.

Would

you

stop

there,

please?

Ref 8

Driver.

Please

stop

there.

Ref 9

Driver.

Could

ask

you

stop

there,

please?

Ref 10

Sir.

Please

stop

there.

Ref 11

Excuse

me.

Kindly

stop

there.

Ref 12

Mister.

Would

you

mind

stopping

over

there?

Ref 13

Driver,

could

you

stop

over

there?

Ref 14

Driver,

would

you

mind

letting

off

over

there?

Ref 15

Driver,

would

you

mind

dropping

off

over

there?

Output 0

The

pilot,

can

stop

this?

N-grams

The	pilot,	can	stop	in	this?
		can	stop

Output 1

can

stop

pilot

N-grams

,	can	stop	pilot	?
	can	stop

Output 2

Driver,

can

stop

it?

N-grams

Driver,	can	stop	it?
Driver,	can	stop
Driver, can

Output 3

Pilot

can

stop

here?

N-grams

Pilot	can	stop	here?
	can	stop

Output 4

The

pilot,

can

stop

this?

N-grams

The	pilot,	can	stop	in	this?
		can	stop

Sentence 443) BLEU: 0 (0.6/0.5/0.3333/0) ; 0 (0.6667/0.2/0/0) ; 0 (0.5/0.1429/0/0) ; 0 (0.6667/0.4/0/0) ; 0 (0.6/0.5/0.3333/0)

Source

�A

��

�q

�@

�q

��

�}

��

�H

Ref 0

Could

you

measure

foot?

Ref 1

Please

measure

foot.

Ref 2

Could

you

check

foot

size?

Ref 3

Please

measure

the

size

foot.

Ref 4

Would

you

please

measure

foot?

Ref 5

Would

you

mind

measuring

foot,

please?

Ref 6

Could

you

check

foot

size,

please?

Ref 7

Would

you

please

measure

foot?

Ref 8

you

mind

taking

measurement

foot?

Ref 9

May

have

foot

measured?

Ref 10

Would

you

mind

checking

what

size

feet

have?

Ref 11

Could

you

kindly

measure

the

size

feet?

Ref 12

Please

measure

foot

size.

Ref 13

Would

you

mind

measuring

feet?

Ref 14

Would

you

mind

measuring

out

foot

size?

Ref 15

Would

you

mind

finding

foot

size?

Output 0

You

can

measure

foot?

N-grams

You	can	measure	my	foot?
		measure	my	foot?
		measure my
		measure my foot?
			my foot?

Output 1

energy

you

foot

measure

N-grams

energy	you	my	foot	measure	?
	you	my	foot	measure
		my foot

Output 2

One

volume

energy

you

foot

it?

N-grams

One	volume	of	energy	you	my	foot	it?
		of		you	my	foot
					my foot

Output 3

Your

energy

measure

feet?

N-grams

Your	energy	a	measure	my	feet?
		a	measure	my	feet?
			measure my
				my feet?

Output 4

You

can

measure

foot?

N-grams

You	can	measure	my	foot?
		measure	my	foot?
		measure my
		measure my foot?
			my foot?

Sentence 444) BLEU: 0 (1/0.8/0.25/0) ; 0 (0.6/0.25/0/0) ; 1 (1/1/1/1) ; 0.7506 (0.8889/0.75/0.7143/0.6667) ; 0 (1/0.8/0.25/0)

Source

�A

�{��

�o

�h�[

�F

�H

Ref 0

How

long

have

you

known

her?

Ref 1

When

did

you

first

meet

her?

Ref 2

How

long

have

you

known

one

another?

Ref 3

How

long

ago

did

you

first

meet

her?

Ref 4

How

long

have

you

been

acquainted

with

her?

Ref 5

How

long

ago

did

you

meet?

Ref 6

How

long

has

been

since

you

first

met?

Ref 7

For

approximately

how

long

have

you

know

her?

Ref 8

For

what

length

time

have

you

known

her?

Ref 9

How

long

has

been

since

you

became

acquainted

with

her?

Ref 10

For

how

long

have

you

been

acquainted

with

her?

Ref 11

How

long

that

you

have

known

her?

Ref 12

Since

when

have

you

known

her?

Ref 13

How

long

have

you

been

acquainted?

Ref 14

For

how

long

have

you

know

her?

Ref 15

How

long

have

you

known

about

her?

Output 0

How

long

did

you

know

her?

N-grams

How	long	did	you	know	her?
How	long	did	you	know	her?
How long		did you		know her?
			you know
			you know her?

Output 1

how

long

you

her

N-grams

how	long	you	her	?
how	long	you
how long

Output 2

How

long

have

you

known

her?

N-grams

How	long	have	you	known	her?
How	long	have	you	known	her?
How long		have you		known her?
How long have			you known
How long have you
	long have		you known her?
	long have you
	long have you known
		have you known
		have you known her?

Output 3

How

long

has

been

since

you

knew

her?

N-grams

How	long	has	it	been	since	you	knew	her?
How	long	has	it	been	since	you		her?
How long		has it		been since
How long has			it been		since you
How long has it				been since you
	long has		it been since
	long has it
	long has it been
		has it been
		has it been since
			it been since you

Output 4

How

long

did

you

know

her?

N-grams

How	long	did	you	know	her?
How	long	did	you	know	her?
How long		did you		know her?
			you know
			you know her?

Sentence 445) BLEU: 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0) ; 0 (0.1667/0/0/0)

Source

��

�ȳ~

�r��

�C

Ref 0

Have

nice

trip.

Ref 1

Have

good

trip.

Ref 2

Have

fun

your

trip.

Ref 3

Enjoy

your

trip.

Ref 4

Have

good

trip.

Ref 5

Enjoy

your

trip.

Ref 6

Have

good

time.

Ref 7

Please

have

enjoyable

trip.

Ref 8

Happy

travels.

Ref 9

Travel

well.

Ref 10

Enjoy

the

trip.

Ref 11

Bon

voyage.

Ref 12

Have

fun

travelling.

Ref 13

Bon

Voyage.

Ref 14

Have

good

trip.

Ref 15

Happy

journeys.

Output 0

wish

pleasant

journey.

N-grams

I	wish	a	pleasant	journey.
		a

Output 1

wish

journey

N-grams

wish

journey

Output 2

wish

pleasant

journey.

N-grams

I	wish	a	pleasant	journey.
		a

Output 3

Wish

travel

delectation.

N-grams

Wish

travel

delectation.

Output 4

Wishes

the

journey

happy.

N-grams

Wishes	the	journey	to	be	happy.
	the

Sentence 446) BLEU: 0 (1/1/0/0) ; 0 (0/0/0/0) ; 0 (1/1/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0)

Source

��

�F

�C

Ref 0

see.

Ref 1

I	understand.

Ref 2

OK.

Ref 3

Alright.

Ref 4

All

right.

Ref 5

OK.

Ref 6

Sure.

Ref 7

I	understand.

Ref 8

It's

clear.

Ref 9

get

the

point.

Ref 10

Understood.

Ref 11

Okay.

Ref 12

Certainly.

Ref 13

I	understand.

Ref 14

get

it.

Ref 15

Understood.

Output 0

I	understand.

N-grams

I	understand.
I	understand.
I understand.

Output 1

understood

N-grams

understood

Output 2

I	understand.

N-grams

I	understand.
I	understand.
I understand.

Output 3

I	understood.

N-grams

I	understood.
I

Output 4

I	understood.

N-grams

I	understood.
I

Sentence 447) BLEU: 0.42 (0.8491/0.5192/0.3529/0.2) ; 0.1724 (0.8049/0.325/0.1282/0.02632) ; 0.42 (0.8491/0.5192/0.3529/0.2) ; 0.1255 (0.7091/0.2407/0.07547/0.01923) ; 0.3694 (0.7857/0.4815/0.3077/0.16)

Source

�C

�

�p��

�Y

�@

��

�o

��

�C

�

�p��

�Y

�@

��

�o��

�C

�p�G

�g�e

��G

�b

�~��

�A

��

�Y

�@

��

�o��

�C

�p�G

��

��W

�g�e

��M

�S��

��

�A

�M

�A

��

��ĳ

�C

�L

�γ\

�

��

�A

�@

��

�w��

�o��

��

�B��

�C

Ref 0

Every

four

hours

take

one

these

tablets.

Take

teaspoonful

this

every

four

hours.

the

diarrhea

seems

continue,

then

take

teaspoonful

this.

doesn't

stop

the

diarrhea

tomorrow,

check

with

your

physician.

He'll

probably

give

you

prescription

item

for

it.

Ref 1

Take

one

these

pills

and

teaspoon

this

every

four

hours,

but

the

diarrhea

doesn't

stop

then

take

teaspoon

this.

the

diarrhea

doesn't

stop

tomorrow,

see

doctor,

please.

He'll

probably

prescribe

some

medicine

for

it.

Ref 2

Take

one

these

tablets

and

teaspoon

this

every

four

hours,

and

the

diarrhea

continues

then

take

teaspoon

this.

the

diarrhea

isn't

stopped

tomorrow,

see

doctor,

please.

He'll

probably

give

you

prescription

for

some

medicine.

Ref 3

Every

four

hours

take

one

these

pills

and

teaspoon

this,

but

the

diarrhea

doesn't

let

then

take

teaspoon

this.

you

still

have

diarrhea

tomorrow

then

see

doctor,

please.

He'll

probably

prescribe

something

for

it.

Ref 4

Take

one

these

pills

every

four

hours

along

with

teaspoon

this.

the

diarrhea

doesn't

seem

stopping,

then

take

teaspoon

this.

the

diarrhea

hasn't

stopped

tomorrow,

please

see

doctor.

She'll

most

likely

give

you

prescription

for

some

medicine

for

the

diarrhea.

Ref 5

Take

one

these

pills

once

every

four

hours

addition

teaspoon

this.

the

diarrhea

appears

ongoing,

then

have

teaspoon

this.

tomorrow,

you

are

still

having

diarrhea,

then

please

see

physician.

She's

probably

going

prescribe

some

medicine

for

you

that

will

work

the

diarrhea.

Ref 6

Once

every

four

hours,

have

one

these

pills

and

along

with

that,

take

teaspoon

this.

the

diarrhea

doesn't

appear

stopping

tomorrow,

please

consult

with

doctor.

She'll

probably

prescribe

some

medicine

that

will

effective.

Ref 7

Take

one

these

tablets

and

also

one

teaspoon

this

every

four

hours,

and

the

diarrhea

persists,

then

take

teaspoon

this.

Call

your

doctor

the

diarrhea

persists

until

tomorrow.

Your

doctor

will

probably

prescribe

you

some

medication.

Ref 8

You

should

take

one

these

pills,

well

one

teaspoon

this

every

four

hours,

and

you

continue

having

diarrhea,

then

take

one

teaspoon

this,

too.

Contact

your

doctor

the

diarrhea

continues

tomorrow.

she

will

most

likely

give

you

prescription

for

some

medication.

Ref 9

suggest

that

you

take

one

these

pills

and

one

teaspoon

this

every

four

hours,

and

your

symptoms

persist,

then

add

teaspoon

this.

your

symptoms

continue

till

tomorrow,

you

should

see

your

doctor.

she

will

possibly

write

you

prescription

for

some

medication.

Ref 10

Take

one

these

tablets

every

four

hours.

Take

teaspoonful

this

also

every

four

hours.

the

diarrhea

persists

until

tomorrow,

take

teaspoonful

this

too.

continues

call

the

doctor.

might

give

you

prescription.

Ref 11

Remember

take

tablet

and

one

teaspoonful

this

every

four

hours.

the

diarrhea

doesn't

stop

then

take

one

teaspoonful

this

also.

the

diarrhea

continues

contact

your

GP.

will

probably

prescribe

you

some

medicine.

Ref 12

One

tablet

and

teaspoonful

this

every

four

hours.

tomorrow

the

diarrhea

has

not

stopped,

take

teaspoonful

this

too.

persists,

call

your

doctor.

Maybe

will

give

prescribe

something.

Ref 13

Take

one

table

every

four

hours

well

teaspoon

this.

the

diarrhea

continues

then

take

teaspoon

this.

doesn't

stop

the

diarrhea

tomorrow

then

see

your

doctor.

will

probably

write

you

prescription

for

diarrhea.

Ref 14

Every

four

hours

take

tablet

and

teaspoon

this.

the

diarrhea

doesn't

stop

then

take

teaspoon

this.

still

doesn't

stop

the

diarrhea

tomorrow

then

consult

your

doctor.

will

likely

write

prescription

for

diarrhea.

Ref 15

Every

four

hours

take

this

pill

and

teaspoon

this.

the

diarrhea

continues

then

take

teaspoon

this.

the

diarrhea

persists

tomorrow

then

consult

your

doctor.

will

probably

issue

you

prescription

for

diarrhea.

Output 0

Every

four

hours

eat

piece

this

medicine.

Every

four

hours

eat

one

teaspoon

this.

the

diarrhea

seems

continue,

then

eat

one

teaspoon

this.

tomorrow

morning

dysentery

still

not

stopped,

then

the

deliberations

and

your

physician.

Perhaps

will

give

you

prescription

for

this.

N-grams

Every

four

hours

eat

piece

this

medicine.

Every

four

hours

eat

one

teaspoon

this.

the

diarrhea

seems

continue,

then

eat

one

teaspoon

this.

tomorrow

morning

dysentery

still

not

stopped,

then

the

deliberations

and

your

physician.

Perhaps

will

give

you

prescription

for

this.

Every

four

hours

this

medicine.

four

one

teaspoon

this.

the

diarrhea

seems

continue,

then

one

teaspoon

this.

tomorrow

still

not

stopped,

then

the

and

your

physician.

will

give

you

prescription

for

Every four

of this

one teaspoon

of this.

If the

diarrhea seems

to continue,

one teaspoon

of this.

not stopped,

your physician.

he will

give you

a prescription

Every four hours

one teaspoon of

this. If

the diarrhea

seems to

continue, then

one teaspoon of

this. If

he will give

you a

prescription for

four hours

teaspoon of

this. If the

diarrhea seems to

teaspoon of

will give

you a prescription

teaspoon of this.

If the diarrhea

seems to continue,

teaspoon of this.

give you a

teaspoon of this. If

the diarrhea seems

to continue, then

teaspoon of this. If

give you a prescription

of this. If

the diarrhea seems to

of this. If

you a prescription for

of this. If the

diarrhea seems to continue,

a prescription for

this. If the diarrhea

seems to continue, then

If the diarrhea seems

Output 1

every

four

hours

eat

this

medicine

every

four

hours

eat

one

teaspoon

this

the

then

one

teaspoon

this

tomorrow

morning

dysentery

still

and

your

will

give

you

prescription

this

take

continuing

N-grams

every

four

hours

eat

this

medicine

every

four

hours

eat

one

teaspoon

this

the

then

one

teaspoon

this

tomorrow

morning

dysentery

still

and

your

will

give

you

prescription

this

take

continuing

every

four

hours

this

medicine

every

four

one

teaspoon

this

the

then

one

teaspoon

tomorrow

still

and

your

will

give

you

prescription

take

every four

of this

every four

one teaspoon

of this

if the

one teaspoon

he will

give you

every four hours

one teaspoon of

he will give

four hours

one teaspoon of this

will give

teaspoon of

teaspoon of this

Output 2

Every

four

hours

eat

piece

this

medicine.

Every

four

hours

eat

one

teaspoon

this.

the

diarrhea

seems

continue,

then

eat

one

teaspoon

this.

tomorrow

morning

dysentery

still

not

stopped,

then

the

deliberations

and

your

physician.

Perhaps

will

give

you

prescription

for

this.

N-grams

Every

four

hours

eat

piece

this

medicine.

Every

four

hours

eat

one

teaspoon

this.

the

diarrhea

seems

continue,

then

eat

one

teaspoon

this.

tomorrow

morning

dysentery

still

not

stopped,

then

the

deliberations

and

your

physician.

Perhaps

will

give

you

prescription

for

this.

Every

four

hours

this

medicine.

four

one

teaspoon

this.

the

diarrhea

seems

continue,

then

one

teaspoon

this.

tomorrow

still

not

stopped,

then

the

and

your

physician.

will

give

you

prescription

for

Every four

of this

one teaspoon

of this.

If the

diarrhea seems

to continue,

one teaspoon

of this.

not stopped,

your physician.

he will

give you

a prescription

Every four hours

one teaspoon of

this. If

the diarrhea

seems to

continue, then

one teaspoon of

this. If

he will give

you a

prescription for

four hours

teaspoon of

this. If the

diarrhea seems to

teaspoon of

will give

you a prescription

teaspoon of this.

If the diarrhea

seems to continue,

teaspoon of this.

give you a

teaspoon of this. If

the diarrhea seems

to continue, then

teaspoon of this. If

give you a prescription

of this. If

the diarrhea seems to

of this. If

you a prescription for

of this. If the

diarrhea seems to continue,

a prescription for

this. If the diarrhea

seems to continue, then

If the diarrhea seems

Output 3

Take

this

kind

medicine

every

four

hours.

Eat

one

teaspoon

every

four

hours

this.

dysentery's

seeming

continuing

and

eat

one

teaspoon

this.

dysentery

will

still

have

tomorrow

morning

stop

words,

and

your

Medicine

the

doctor

negotiate.

probably

will

give

you

prescription

that

aims

this.

N-grams

Take

this

kind

medicine

every

four

hours.

Eat

one

teaspoon

every

four

hours

this.

dysentery's

seeming

continuing

and

eat

one

teaspoon

this.

dysentery

will

still

have

tomorrow

morning

stop

words,

and

your

Medicine

the

doctor

negotiate.

probably

will

give

you

prescription

that

aims

this.

Take

this

medicine

every

four

hours.

one

teaspoon

every

four

hours

this.

and

one

teaspoon

this.

will

still

have

tomorrow

stop

and

your

the

doctor

probably

will give

you

prescription

that

every four

one teaspoon

every four

this. If

one teaspoon

this. If

still have

give

you a

every four hours.

every four hours

give you

a prescription

four hours.

four hours

give you a

give you a prescription

you a prescription

Output 4

Every

four

hours

take

tablet

this

medicine.

Every

four

hours

eat

one

teaspoon

this.

dysentery

continuing,

then

eats

one

teaspoon

N-grams

Every

four

hours

take

tablet

this

medicine.

Every

four

hours

eat

one

teaspoon

this.

dysentery

continuing,

then

eats

one

teaspoon

Every

four

hours

take

tablet

this

medicine.

four

one

teaspoon

this.

then

one

teaspoon

Every four

hours take

a tablet

of this

one teaspoon

of this.

one teaspoon

Every four hours

take a

one teaspoon of

this. If

Every four hours take

teaspoon of

four hours

take a tablet

teaspoon of this.

four hours take

teaspoon of this. If

four hours take a

of this. If

hours take a

hours take a tablet

Sentence 448) BLEU: 0 (0.6667/0/0/0) ; 0 (0.6/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.5/0.1429/0/0) ; 0 (0.6667/0/0/0)

Source

��

��R��

�渨

�F

�C

Ref 0

The

filling

came

out

tooth.

Ref 1

tooth

filling

came

out.

Ref 2

filling

has

come

loose.

Ref 3

tooth

has

lost

its

filling.

Ref 4

The

filling

came

loose

from

tooth.

Ref 5

The

filling

pulled

out

tooth.

Ref 6

The

filling

fell

out

tooth.

Ref 7

I've

lost

the

filling

from

tooth.

Ref 8

filling

has

come

loose

from

tooth.

Ref 9

tooth

has

lost

its

filling.

Ref 10

The

filling

came

off.

Ref 11

tooth

has

lost

its

filling.

Ref 12

filling

fell

out.

Ref 13

filling

popped

out

tooth.

Ref 14

tooth

lost

filling.

Ref 15

I've

lost

filling.

Output 0

tooth's

filling

material

fell

off.

N-grams

My	tooth's	filling	material	fell	off.
My		filling		fell	off.

Output 1

fell

off

tooth

N-grams

my	fell	off	tooth	.
my	fell		tooth

Output 2

teeth

fell

off

filler.

N-grams

My	teeth	fell	off	filler.
My		fell

Output 3

tooth

filled

thing

shed

off.

N-grams

My	tooth	filled	a	thing	to	shed	off.
My	tooth		a				off.
My tooth

Output 4

tooth's

filling

material

fell

off.

N-grams

My	tooth's	filling	material	fell	off.
My		filling		fell	off.

Sentence 449) BLEU: 0 (0.5/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.3333/0/0/0)

Source

�L

��

�X�h

�F

�C

Ref 0

He's

out

right

now.

Ref 1

He's

out

now.

Ref 2

Right

now

out.

Ref 3

He's

not

now.

Ref 4

He's

not

here

right

now.

Ref 5

He's

not

the

moment.

Ref 6

He's

out

the

moment.

Ref 7

He's

stepped

out.

Ref 8

He's

not

right

now.

Ref 9

He's

not

available

now.

Ref 10

He's

not

here

the

moment.

Ref 11

absent.

Ref 12

He's

not

now.

Ref 13

He's

not

the

moment.

Ref 14

He's

not

here

the

moment.

Ref 15

He's

not

available

the

moment.

Output 0

just

went

out.

N-grams

He	just	went	out.
He			out.

Output 1

just

went

out

N-grams

he	just	went	out	.
he			out

Output 2

just

went

out.

N-grams

He	just	went	out.
He			out.

Output 3

just

went

out.

N-grams

He	just	went	out.
He			out.

Output 4

just

exited.

N-grams

He	just	exited.
He

Sentence 450) BLEU: 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0)

Source

�]�A

�O�I�O

��

�H

Ref 0

insurance

included?

Ref 1

insurance

part

the

package?

Ref 2

insurance

part

it?

Ref 3

there

insurance

with

it?

Ref 4

Does

this

include

insurance?

Ref 5

Does

the

insurance

come

with

it?

Ref 6

the

insurance

part

the

deal?

Ref 7

Will

insurance

included?

Ref 8

Does

that

include

insurance?

Ref 9

Does

insurance

come

included?

Ref 10

Does

include

insurance?

Ref 11

Would

insured?

Ref 12

Will

covered

insurance?

Ref 13

Does

come

with

insurance?

Ref 14

Does

that

also

include

insurance?

Ref 15

Does

the

insurance

come

with

it?

Output 0

Including

the

premium

it?

N-grams

Including	the	premium	it?
	the		it?

Output 1

including

premium

N-grams

including

premium

Output 2

Including

the

premium

it?

N-grams

Including	the	premium	it?
	the		it?

Output 3

Include

premium?

N-grams

Include

premium?

Output 4

Including

insurance

premium?

N-grams

Including	insurance	premium?
	insurance

Sentence 451) BLEU: 0 (0.2/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.2/0/0/0) ; 0 (0/0/0/0)

Source

��

�@

��

�p

��

�C

Ref 0

Small,

please.

Ref 1

Please

give

small

size.

Ref 2

Please

give

small.

Ref 3

small,

please.

Ref 4

small

one,

please.

Ref 5

Please

give

small.

Ref 6

I'll

have

small,

please.

Ref 7

I'd

small,

please.

Ref 8

Please

give

small.

Ref 9

want

small,

please.

Ref 10

I'd

small.

Ref 11

I'll

have

small

size.

Ref 12

Get

small

one.

Ref 13

small

size

please.

Ref 14

Please

give

small.

Ref 15

Please

give

small

one.

Output 0

Pleasing

one

small.

N-grams

Pleasing	to	one	is	small.
				small.

Output 1

small

one

N-grams

small	one	.
small

Output 2

Invited

small.

N-grams

Invited	a	small.
	a	small.
	a small.

Output 3

Pleasing

one

small.

N-grams

Pleasing	to	one	is	small.
				small.

Output 4

Invites

one

slightly.

N-grams

Invites

one

slightly.

Sentence 452) BLEU: 0 (0.8333/0.4/0/0) ; 0 (0.5714/0.1667/0/0) ; 0 (0.8333/0.4/0/0) ; 0 (0.5/0/0/0) ; 0 (0.8/0.25/0/0)

Source

�

�A

��n

��

�o��

�C

Ref 0

No,

don't

worry

about

it.

Ref 1

Nope,

don't

give

second

thought.

Ref 2

worries.

Ref 3

No,

don't

worry

about

anything.

Ref 4

No,

please

don't

bother

about

it.

Ref 5

No,

please

don't

give

second

thought.

Ref 6

No,

please

don't

concern

yourself

about

it.

Ref 7

No,

it's

problem.

Ref 8

Nah,

isn't

big

deal.

Ref 9

No,

don't

concerned.

Ref 10

It's

okay,

please

don't

concerned.

Ref 11

Don't

let

worry

you.

Ref 12

It's

fine,

not

let

bother

you.

Ref 13

No,

it's

concern.

Ref 14

No,

not

problem.

Ref 15

No,

nothing

concerned

about.

Output 0

No,

not

worry

about

this.

N-grams

No,	do	not	worry	about	this.
No,	do	not	worry	about
	do not		worry about

Output 1

not

worry

this

N-grams

no	,	do	not	worry	this	.
no		do	not	worry
		do not

Output 2

No,

not

worry

about

this.

N-grams

No,	do	not	worry	about	this.
No,	do	not	worry	about
	do not		worry about

Output 3

Don't

worry

this

not.

N-grams

Don't	worry	this	not.
Don't	worry

Output 4

No,

not

worry

this.

N-grams

No,	do	not	worry	this.
No,	do	not	worry
	do not

Sentence 453) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.6/0/0/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.8/0.5/0/0) ; 0 (1/0.6667/0/0)

Source

��

��@�T��

�C

Ref 0

Please

take

that

bus.

Ref 1

Please

ride

that

bus.

Ref 2

Please

get

that

bus.

Ref 3

Please

use

that

bus.

Ref 4

Please

get

that

bus.

Ref 5

That's

the

bus

you

want.

Ref 6

That's

your

bus.

Ref 7

You

should

take

that

bus.

Ref 8

That's

the

bus

you

should

take.

Ref 9

Get

that

bus,

please.

Ref 10

You

need

get

that

bus.

Ref 11

advise

you

get

that

bus.

Ref 12

Try

board

that

bus.

Ref 13

Please

get

that

bus.

Ref 14

Please

ride

that

bus.

Ref 15

Please

grab

that

bus.

Output 0

Please

take

that

bus

trip.

N-grams

Please	take	that	bus	trip.
Please	take	that	bus
Please take
Please take that
	take that

Output 1

please

that

bus

ride

N-grams

please	that	bus	ride	.
	that	bus	ride

Output 2

Please

take

that

bus

trip.

N-grams

Please	take	that	bus	trip.
Please	take	that	bus
Please take
Please take that
	take that

Output 3

Please

ride

that

bus.

N-grams

Please	ride	in	that	bus.
Please	ride		that	bus.
Please ride			that bus.

Output 4

Please

ride

that

bus.

N-grams

Please	ride	that	bus.
Please	ride	that	bus.
Please ride		that bus.

Sentence 454) BLEU: 0 (0.4444/0.25/0/0) ; 0 (0.2/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0/0/0/0) ; 0 (0.4444/0.25/0/0)

Source

�A��

��

�a

�V

��

�H

Ref 0

What

poultry

dishes

you

serve?

Ref 1

What

kind

chicken

dishes

you

serve?

Ref 2

What

sort

chicken

dishes

you

serve?

Ref 3

What

chicken

dishes

you

have?

Ref 4

What

kind

chicken

dishes

you

have?

Ref 5

What

types

chicken

dishes

are

there?

Ref 6

What

you

have

the

way

chicken?

Ref 7

What

kinds

chicken

dishes

you

have?

Ref 8

What

are

the

chicken

dishes

that

you

serve?

Ref 9

terms

chicken

dishes,

what's

available?

Ref 10

What

chicken

dishes

you

have?

Ref 11

you

have

any

dishes

with

chicken

meet?

Ref 12

What

kind

poultry

meals

you

have?

Ref 13

What

kinds

chicken

dishes

you

have?

Ref 14

What

kinds

chicken

items

you

have?

Ref 15

What

sorts

cooking

you

serve

with

chicken?

Output 0

Which

kind

domesticated

fowl

vegetable

you

supply?

N-grams

Which	kind	of	domesticated	fowl	vegetable	do	you	supply?
	kind	of				do	you
	kind of					do you

Output 1

which

you

supply

fowl

N-grams

which	you	supply	fowl	?
	you

Output 2

Poultry

dishes

which

you

supply?

N-grams

Poultry	dishes	which	you	supply?
	dishes		you

Output 3

You

supply

which

domestic

fowl

vegetables?

N-grams

You

supply

which

domestic

fowl

vegetables?

Output 4

Which

kind

domesticated

fowl

vegetable

you

supply?

N-grams

Which	kind	of	domesticated	fowl	vegetable	do	you	supply?
	kind	of				do	you
	kind of					do you

Sentence 455) BLEU: 0.5659 (0.8462/0.6667/0.4545/0.4) ; 0 (0.5833/0.2727/0.1/0) ; 0.5659 (0.8462/0.6667/0.4545/0.4) ; 0 (0.6667/0.1818/0/0) ; 0 (0.6923/0.3333/0.09091/0)

Source

��

�A

�ҤH

�C

��

�o��

��

�X�ǭ�

��

�b

��

�I��

�C

Ref 0

Thank

you,

ma'am.

Please

take

this

bill

the

cashier

and

pay

there.

Ref 1

Thank

you.

Please

pay

for

this

bill

the

cashier.

Ref 2

Thanks.

Please

pay

this

bill

the

cashier.

Ref 3

Thank

you.

Please

take

this

bill

over

the

cashier

and

pay

for

there.

Ref 4

Thank

you

much.

Please

give

this

voucher

the

cashier

and

pay

there.

Ref 5

Thank

you

very

much.

you

would,

please

take

this

voucher

the

cashier

where

you

can

pay.

Ref 6

Thank

you

ever

so.

Please

bring

this

bill

the

cashier

and

you

can

pay

there.

Ref 7

Thank

you,

would

you

please

pay

this

bill

the

cashier?

Ref 8

Thank

you

very

much,

you

mind

taking

this

bill

the

cashier

and

paying

there?

Ref 9

Thank

you,

the

bill

should

brought

the

cashier

and

paid

there.

Ref 10

was

pleasure

serve

you.

Would

you

kindly

and

pay

the

bill

the

cashier?

Ref 11

Thank

you

for

shopping

here.

Pay

the

bill

the

cashier.

Ref 12

Have

great

day.

You

need

settle

the

bill

the

cashier.

Ref 13

Thank

you

very

much.

Please

take

this

bill

and

pay

the

cashier.

Ref 14

Thank

you

very

much.

Please

pay

your

bill

the

cashier.

Ref 15

Thank

you

very

much.

Please

pay

your

bill

the

cashier's

desk.

Output 0

Thank

you,

madam.

Please

send

the

bill

the

cashier

and

pay

there.

N-grams

Thank

you,

madam.

Please

send

the

bill

the

cashier

and

pay

there.

Thank

you,

Please

the

bill

the

cashier

and

pay

there.

Thank you,

the bill

to the

cashier and

pay there.

bill to

the cashier

and pay

bill to the

cashier and pay

bill to the cashier

and pay there.

to the cashier

to the cashier and

the cashier and

the cashier and pay

cashier and pay there.

Output 1

thank

madam

please

the

bill

cashier

and

pay

there

this

N-grams

thank	,	madam	please	the	bill	cashier	and	pay	there	this	.
			please	the	bill	cashier	and	pay		this
				the bill		cashier and
						cashier and pay
							and pay

Output 2

Thank

you,

madam.

Please

send

the

bill

the

cashier

and

pay

there.

N-grams

Thank

you,

madam.

Please

send

the

bill

the

cashier

and

pay

there.

Thank

you,

Please

the

bill

the

cashier

and

pay

there.

Thank you,

the bill

to the

cashier and

pay there.

bill to

the cashier

and pay

bill to the

cashier and pay

bill to the cashier

and pay there.

to the cashier

to the cashier and

the cashier and

the cashier and pay

cashier and pay there.

Output 3

Thank,

madam.

Please

give

cashier

this

Zhang

list

and

pay

over

there.

N-grams

Thank,	madam.	Please	give	cashier	this	Zhang	list	and	pay	over	there.
		Please	give	cashier	this			and	pay	over	there.
		Please give						and pay

Output 4

Thanks,

madame.

Please

pay

money

this

bill

for

the

cashier

and

there.

N-grams

Thanks,

madame.

Please

pay

money

this

bill

for

the

cashier

and

there.

Please

pay

this

bill

for

the

cashier

and

there.

Please pay

this bill

the cashier

the cashier and

cashier and

Sentence 456) BLEU: 0 (0.4/0.2222/0.125/0) ; 0 (0.4286/0.1667/0/0) ; 0 (0.7143/0.1667/0/0) ; 0 (0.3636/0.2/0.1111/0) ; 0 (0.2857/0/0/0)

Source

�A

��

��ͯ�

��

�C�Z

��

�H

Ref 0

you

have

chewable

vitamin

Ref 1

you

have

any

chewable

vitamin

Ref 2

there

any

chewable

vitamin

here?

Ref 3

you

have

any

chewable

vitamin

stock?

Ref 4

you

carry

chewable

vitamin

tablets?

Ref 5

Are

there

any

chewable

vitamin

pills?

Ref 6

Would

you

have

vitamin

chewable

form?

Ref 7

Would

you

carry

any

chewable

vitamin

Ref 8

there

any

chewable

vitamin

available?

Ref 9

Are

you

selling

any

chewable

vitamin

Ref 10

Would

you

happen

have

vitamin

tablets

that

can

chew?

Ref 11

you

have

any

vitamin

chews?

Ref 12

Are

there

any

chewable

vitamin

tablets?

Ref 13

there

any

chewable

vitamin

Ref 14

you

carry

chewable

vitamin

Ref 15

you

sell

chewable

vitamin

Output 0

you

have

the

mastication

slice

the

vitamin

��?

N-grams

Do	you	have	the	mastication	slice	of	the	vitamin	��?
Do	you	have						vitamin
Do you
Do you have
	you have

Output 1

vitamin

you

have

the

mastication

N-grams

vitamin	c	you	have	the	mastication	?
vitamin		you	have
		you have

Output 2

Vitamin

chewable

tablets

you

have

it?

N-grams

Vitamin	C	chewable	tablets	you	have	it?
	C	chewable	tablets	you	have
				you have

Output 3

you

have

the

mastication

slice

the

vitamin

��

N-grams

Do	you	have	the	mastication	slice	of	the	vitamin	��	?
Do	you	have						vitamin
Do you
Do you have
	you have

Output 4

You

have

the

Vitamin

mastication

piece?

N-grams

You	have	the	Vitamin	C	mastication	piece?
	have			C

Sentence 457) BLEU: 0 (1/1/1/0) ; 0 (0.25/0/0/0) ; 0 (1/1/1/0) ; 0 (1/1/1/0) ; 0 (1/1/1/0)

Source

��

�C

Ref 0

Please,

have

seat.

Ref 1

Please

sit

down.

Ref 2

Sit

down,

please.

Ref 3

Have

seat,

please.

Ref 4

Please

sit

down.

Ref 5

Take

seat,

please.

Ref 6

Grab

seat,

please.

Ref 7

Take

seat,

please.

Ref 8

Would

you

take

seat?

Ref 9

Why

don't

you

park

yourself

there.

Ref 10

Would

you

have

seat?

Ref 11

Take

seat.

Ref 12

Sit

down.

Ref 13

Please,

sit

down.

Ref 14

Please,

seat

yourself.

Ref 15

Please

seated.

Output 0

Please

sit

down.

N-grams

Please	sit	down.
Please	sit	down.
Please sit
Please sit down.
	sit down.

Output 1

please

sit

down

N-grams

please	sit	down	.
	sit

Output 2

Please

sit

down.

N-grams

Please	sit	down.
Please	sit	down.
Please sit
Please sit down.
	sit down.

Output 3

Please

sit

down.

N-grams

Please	sit	down.
Please	sit	down.
Please sit
Please sit down.
	sit down.

Output 4

Please

sit

down.

N-grams

Please	sit	down.
Please	sit	down.
Please sit
Please sit down.
	sit down.

Sentence 458) BLEU: 1 (1/1/1/1) ; 0 (0.5/0.4/0.25/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0 (0.8333/0.4/0.25/0)

Source

��

�i�D

��

�A

��

�a�}

�C

Ref 0

Tell

your

address,

please.

Ref 1

Please

tell

your

address.

Ref 2

Please

give

your

address.

Ref 3

Give

your

address,

please.

Ref 4

Please

give

your

address.

Ref 5

Please

tell

where

you

live.

Ref 6

Please

tell

where

your

residence

is.

Ref 7

Would

you

give

your

address,

please?

Ref 8

Please

give

your

address.

Ref 9

Could

get

your

address,

please?

Ref 10

Tell

your

address.

Ref 11

I'd

know

your

address.

Ref 12

Can

have

your

address?

Ref 13

Give

your

address,

please.

Ref 14

Your

address,

please.

Ref 15

Please

tell

where

you

live.

Output 0

Please

tell

your

address.

N-grams

Please	tell	me	your	address.
Please	tell	me	your	address.
Please tell		me your
Please tell me			your address.
Please tell me your
	tell me
	tell me your
	tell me your address.
		me your address.

Output 1

please

tell

your

address

N-grams

please	tell	me	your	address	.
	tell	me	your
	tell me
	tell me your
		me your

Output 2

Please

tell

your

address.

N-grams

Please	tell	me	your	address.
Please	tell	me	your	address.
Please tell		me your
Please tell me			your address.
Please tell me your
	tell me
	tell me your
	tell me your address.
		me your address.

Output 3

Please

tell

your

address.

N-grams

Please	tell	me	your	address.
Please	tell	me	your	address.
Please tell		me your
Please tell me			your address.
Please tell me your
	tell me
	tell me your
	tell me your address.
		me your address.

Output 4

Please

tell

you

the

address.

N-grams

Please	tell	me	you	the	address.
Please	tell	me	you		address.
Please tell
Please tell me
	tell me

Sentence 459) BLEU: 0 (0.25/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.4/0/0/0)

Source

��

�O

�Ĩ�

��

�H

Ref 0

sour?

Ref 1

this

sour?

Ref 2

Does

this

have

sour

taste?

Ref 3

this

dish

sour?

Ref 4

Does

taste

sour?

Ref 5

the

taste

sour?

Ref 6

Does

have

sour

taste?

Ref 7

Does

taste

sour?

Ref 8

you

find

sour?

Ref 9

there

tart

flavor?

Ref 10

Does

taste

sour?

Ref 11

Does

have

sour

taste?

Ref 12

Sour?

Ref 13

Does

taste

sour?

Ref 14

Does

have

sour

taste?

Ref 15

tart?

Output 0

sour

it?

N-grams

It	is	sour	it?
		sour

Output 1

sour

N-grams

it	is	sour	?
it		sour

Output 2

sour

it?

N-grams

It	is	sour	it?
		sour

Output 3

acerbity?

N-grams

Is	it	an	acerbity?
Is	it
Is it

Output 4

the

sour

odor?

N-grams

It	is	the	sour	odor?
		the	sour

Sentence 460) BLEU: 1 (1/1/1/1) ; 0 (0.4/0/0/0) ; 0 (0.6/0/0/0) ; 1 (1/1/1/1) ; 0 (0.6/0/0/0)

Source

��

�B��

��

�H

Ref 0

Can

get

there

foot?

Ref 1

Can

there

foot?

Ref 2

Can

walk

there?

Ref 3

within

walking

distance?

Ref 4

Can

get

there

walking?

Ref 5

Can

walk

there?

Ref 6

possible

foot?

Ref 7

possible

get

there

foot?

Ref 8

Would

able

walk

there?

Ref 9

walking

there

realistic?

Ref 10

possible

walk

there?

Ref 11

Could

walk

there?

Ref 12

within

walking

distance?

Ref 13

Can

walk

there?

Ref 14

possible

walk

there?

Ref 15

within

walking

distance?

Output 0

Can

walk

there?

N-grams

Can	I	walk	there?
Can	I	walk	there?
Can I		walk there?
Can I walk
Can I walk there?
	I walk
	I walk there?

Output 1

can

walk

there

N-grams

i	can	walk	there	?
		walk	there

Output 2

can

walk

you

there?

N-grams

I	can	walk	you	there?
I		walk		there?

Output 3

Can

walk

there?

N-grams

Can	I	walk	there?
Can	I	walk	there?
Can I		walk there?
Can I walk
Can I walk there?
	I walk
	I walk there?

Output 4

can

walk

that?

N-grams

I	can	walk	to	that?
I		walk	to

Sentence 461) BLEU: 0 (0.8/0.5/0.3333/0) ; 0 (0.8/0.75/0.3333/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.6/0.25/0/0)

Source

�o��

��

�p

�F

�C

Ref 0

The

brim

too

small.

Ref 1

This

brim

not

big

enough.

Ref 2

The

brim

this

too

small.

Ref 3

The

brim

too

narrow.

Ref 4

The

brim

isn't

big

enough.

Ref 5

The

brim

isn't

wide

enough.

Ref 6

The

brim

too

narrow.

Ref 7

think

the

brim

overly

small.

Ref 8

It's

got

brim

which

too

small.

Ref 9

There

not

enough

brim.

Ref 10

has

far

too

small

brim.

Ref 11

The

brim

too

narrow.

Ref 12

The

brim

too

little.

Ref 13

The

brim

isn't

large

enough.

Ref 14

The

brim

too

small.

Ref 15

The

brim

too

small.

Output 0

This

side

too

small.

N-grams

This	side	is	too	small.
This		is	too	small.
		is too
		is too small.
			too small.

Output 1

this

too

small

N-grams

this	is	too	small	.
this	is	too	small
this is		too small
this is too
	is too

Output 2

This

edge

too

small.

N-grams

This	edge	is	too	small.
This		is	too	small.
		is too
		is too small.
			too small.

Output 3

This

side

too

small.

N-grams

This	side	is	too	small.
This		is	too	small.
		is too
		is too small.
			too small.

Output 4

Nearby

this

was

too

small.

N-grams

Nearby	this	was	too	small.
	this		too	small.
			too small.

Sentence 462) BLEU: 0 (0.75/0.6667/0.5/0) ; 0 (0.4/0.25/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (0.5/0.4/0.25/0) ; 0.3656 (0.625/0.4286/0.3333/0.2)

Source

��

�Q

�n

��

�}

�C

Ref 0

I'd

get

ears

pierced.

Ref 1

want

get

ears

pierced.

Ref 2

want

have

ears

pierced.

Ref 3

I'd

pierce

ears.

Ref 4

want

have

ears

pierced.

Ref 5

I'm

interested

getting

ears

pierced.

Ref 6

I'd

have

ears

pierced.

Ref 7

Could

have

ears

pierced,

please?

Ref 8

want

ears

pierced.

Ref 9

I'm

hoping

get

ears

pierced.

Ref 10

would

have

pierced

ears.

Ref 11

would

get

holes

put

ears.

Ref 12

want

pierce

ears.

Ref 13

would

have

ears

pierced.

Ref 14

would

you

pierce

ears.

Ref 15

Could

you

pierce

ears?

Output 0

want

穿�\x80��\xB4\x9E.

N-grams

I	want	to	穿�\x80��\xB4\x9E.
I	want	to
I want
I want to
	want to

Output 1

want

hole

N-grams

i	want	to	hole	.
	want	to
	want to

Output 2

want

to穿耳洞.

N-grams

I	want	to穿耳洞.
I	want
I want

Output 3

want

wear

ear

hole.

N-grams

I	want	to	wear	ear	hole.
I	want	to
I want
I want to
	want to

Output 4

want

pierce

the

ears

the

hole.

N-grams

I	want	to	pierce	the	ears	the	hole.
I	want	to	pierce		ears
I want		to pierce
I want to
I want to pierce
	want to
	want to pierce

Sentence 463) BLEU: 0 (0.625/0/0/0) ; 0 (0.4/0/0/0) ; 0 (0/0/0/0) ; 0 (0.625/0/0/0) ; 0 (0.75/0.3333/0/0)

Source

@��

��

�F��

�C

Ref 0

Something

medium

price

range.

Ref 1

Something

the

medium

price

range.

Ref 2

medium

priced

thing.

Ref 3

Something

priced

the

medium

range.

Ref 4

Something

for

moderate

price.

Ref 5

medium-priced

item.

Ref 6

Something

mid-range

price.

Ref 7

Please

give

something

that's

average

price.

Ref 8

I'd

something

your

average

price

range.

Ref 9

I'll

take

something

your

mid-price

range.

Ref 10

medium-priced

dish.

Ref 11

dish

which

not

too

expensive.

Ref 12

Something

medium

price.

Ref 13

Something

the

mid

price

range.

Ref 14

would

prefer

something

middle

price

range.

Ref 15

reasonable

price

range.

Output 0

Some

medium

wait

for

the

thing

price.

N-grams

Some	medium	wait	for	the	thing	of	price.
	medium		for	the		of	price.

Output 1

some

medium

thing

price

N-grams

some	medium	thing	price	.
	medium		price

Output 2

Some

mid-priced

things.

N-grams

Some

mid-priced

things.

Output 3

Some

medium

wait

for

the

thing

price.

N-grams

Some	medium	wait	for	the	thing	of	price.
	medium		for	the		of	price.

Output 4

Some

medium

price

thing.

N-grams

Some	medium	price	thing.
	medium	price	thing.
	medium price

Sentence 464) BLEU: 0 (1/0.5/0/0) ; 0 (0.2/0/0/0) ; 0 (0.4444/0/0/0) ; 0 (0.6667/0.2/0/0) ; 0 (1/0.5/0/0)

Source

�藍�_

�A

��

�C

Ref 0

Sorry,

can't

that.

Ref 1

I'm

afraid

cannot

that.

Ref 2

I'm

sorry

that

not

possible.

Ref 3

I'm

afraid

cannot

done.

Ref 4

I'm

afraid

that's

impossible.

Ref 5

I'm

afraid

that

can't

done.

Ref 6

I'm

afraid

can't

that.

Ref 7

Sorry,

but

that's

just

not

possible.

Ref 8

apologies

but

I'm

unable

that.

Ref 9

Forgive

me,

but

that's

not

something

that

can

do.

Ref 10

Excuse

but

can't

manage

that.

Ref 11

not

the

position

that,

sorry.

Ref 12

apologize

but

not

able

that.

Ref 13

sorry

but

that

impossible.

Ref 14

terribly

sorry

but

not

possible.

Ref 15

really

sorry

but

not

possible.

Output 0

Sorry,

cannot

that

do.

N-grams

Sorry,	I	cannot	that	do.
Sorry,	I	cannot	that	do.
Sorry, I
	I cannot

Output 1

N-grams

i	,	do	so	.
		do

Output 2

beg

your

pardon,

should

not

so.

N-grams

I	beg	your	pardon,	I	should	not	do	so.
I				I		not	do

Output 3

Execuse

me,

can't

do.

N-grams

Execuse	me,	I	can't	so	do.
	me,	I	can't		do.
		I can't

Output 4

Sorry,

cannot

that

do.

N-grams

Sorry,	I	cannot	that	do.
Sorry,	I	cannot	that	do.
Sorry, I
	I cannot

Sentence 465) BLEU: 0 (0.6667/0/0/0) ; 0 (0.4/0.25/0/0) ; 0 (1/1/1/0) ; 0 (0.6667/0.5/0/0) ; 0 (1/1/1/0)

Source

�

�A

��O

��

�H

Ref 0

No,

but

why?

Ref 1

Not

really,

but

why?

Ref 2

No,

but

why

would

you?

Ref 3

No,

but

why

you

want

it?

Ref 4

No,

that's

OK,

but

how

come?

Ref 5

No,

that's

fine,

but

why?

Ref 6

No,

that's

all

right,

but

what

for?

Ref 7

don't

mind,

but

why?

Ref 8

It's

okay,

but

why

would

you

want

to?

Ref 9

Sure,

but

what's

the

big

deal?

Ref 10

problem,

but

may

ask

why?

Ref 11

Fine,

but

what

for?

Ref 12

Okay,

but

why

would

you

want

that?

Ref 13

It's

alright

but

want

know

why?

Ref 14

Sure,

but

how

come?

Ref 15

Okay,

but

why

are

you

interested?

Output 0

No,

But

why?

N-grams

No,	But	why?
No,		why?

Output 1

but

why

N-grams

no	,	but	why	?
		but	why
		but why

Output 2

No,

but

why?

N-grams

No,	but	why?
No,	but	why?
No, but
No, but why?
	but why?

Output 3

Not,

but

why?

N-grams

Not,	but	why?
	but	why?
	but why?

Output 4

No,

but

why?

N-grams

No,	but	why?
No,	but	why?
No, but
No, but why?
	but why?

Sentence 466) BLEU: 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0)

Source

��

�H

Ref 0

Where

to?

Ref 1

Where

you

want

go?

Ref 2

What's

your

destination?

Ref 3

Where

are

you

going?

Ref 4

Where

are

you

going?

Ref 5

Where

you

want

go?

Ref 6

What's

your

destination?

Ref 7

Where

you

want

go?

Ref 8

Where

are

you

going?

Ref 9

Which

place?

Ref 10

Where

you

want

go?

Ref 11

Where

are

heading?

Ref 12

Where

may

take

you?

Ref 13

Where

are

you

headed?

Ref 14

What's

your

destination?

Ref 15

Where

to?

Output 0

Where?

N-grams

Where?

Output 1

where

N-grams

where

Output 2

Where?

N-grams

Where?

Output 3

Last

where?

N-grams

Last

where?

Output 4

Where

gets

up?

N-grams

Where	gets	up?
Where

Sentence 467) BLEU: 0 (1/0.6667/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.8/0.25/0/0) ; 0 (1/0.6667/0/0) ; 0 (0.8333/0/0/0)

Source

��

�S��

�ʶR

��ĳ

�C

Ref 0

don't

have

the

purchase

agreement.

Ref 1

don't

have

the

purchase

slip.

Ref 2

don't

know

where

the

purchase

slip

is.

Ref 3

don't

have

copy

the

purchase

slip.

Ref 4

don't

have

the

purchase

document

me.

Ref 5

didn't

bring

the

purchase

memo

with

me.

Ref 6

The

purchase

agreement

isn't

with

me.

Ref 7

I've

misplaced

the

purchase

agreement.

Ref 8

longer

hold

the

purchase

agreement.

Ref 9

I'm

longer

possession

the

purchase

agreement.

Ref 10

haven't

got

the

purchase

agreement.

Ref 11

I'm

not

possession

the

purchase

agreement.

Ref 12

The

purchase

agreement

not

possession.

Ref 13

don't

have

copy

the

purchase

agreement.

Ref 14

don't

have

receipt

the

purchase

agreement.

Ref 15

don't

have

the

copy

the

purchase

contract.

Output 0

didn't

purchase

agreement.

N-grams

I	didn't	purchase	agreement.
I	didn't	purchase	agreement.
I didn't		purchase agreement.

Output 1

not

purchase

agreement

N-grams

i	not	purchase	agreement	.
	not	purchase	agreement
		purchase agreement

Output 2

did

not

purchase

agreement.

N-grams

I	did	not	purchase	agreement.
I		not	purchase	agreement.
			purchase agreement.

Output 3

didn't

purchase

agreement.

N-grams

I	didn't	purchase	agreement.
I	didn't	purchase	agreement.
I didn't		purchase agreement.

Output 4

have

not

purchased

the

agreement.

N-grams

I	have	not	purchased	the	agreement.
I	have	not		the	agreement.

Sentence 468) BLEU: 0 (0.5714/0.3333/0.2/0) ; 0 (0.6/0/0/0) ; 0 (0.5714/0.3333/0.2/0) ; 0 (0.4/0/0/0) ; 0 (0.75/0.3333/0/0)

Source

��

�]�A

�T�o

��

�H

Ref 0

Does

that

include

the

price

gas?

Ref 1

the

price

gas

included?

Ref 2

the

gasoline

price

included?

Ref 3

Does

that

price

include

the

gasoline

price?

Ref 4

gas

included

that?

Ref 5

that

with

the

gas?

Ref 6

Does

that

cover

the

gas,

too?

Ref 7

Would

that

include

the

cost

for

gas?

Ref 8

that

including

the

cost

for

gas?

Ref 9

the

cost

for

gas

included

that?

Ref 10

the

cost

gas

included?

Ref 11

that

with

gas

included?

Ref 12

gas

included?

Ref 13

the

charge

for

gasoline

included

that?

Ref 14

the

gas

included

with

that

price?

Ref 15

the

price

gas

also

included

that

price?

Output 0

That

includes

the

price

gasoline

it?

N-grams

That	includes	the	price	of	gasoline	it?
		the	price	of	gasoline
		the price
		the price of
			price of

Output 1

that

includes

price

gasoline

N-grams

that	includes	price	gasoline	?
that		price	gasoline

Output 2

That

includes

the

price

gasoline

it?

N-grams

That	includes	the	price	of	gasoline	it?
		the	price	of	gasoline
		the price
		the price of
			price of

Output 3

That

price

that

includes

gasoline?

N-grams

That	price	that	includes	gasoline?
	price	that

Output 4

Then

including

gasoline

price?

N-grams

Then	including	gasoline	price?
	including	gasoline	price?
		gasoline price?

Sentence 469) BLEU: 0 (0.8/0.5/0/0) ; 0 (0.4/0/0/0) ; 0 (0.75/0/0/0) ; 0 (1/0.6667/0.5/0) ; 0 (0.8/0.5/0/0)

Source

��

�_��

��

�H

Ref 0

Can

have

the

key,

please?

Ref 1

Please

give

the

key.

Ref 2

Please

let

have

the

key.

Ref 3

Please

give

the

key

me.

Ref 4

Could

get

key,

please?

Ref 5

Would

you

hand

key,

please?

Ref 6

key,

please.

Ref 7

Could

you

give

the

key,

please?

Ref 8

I'd

the

key,

please.

Ref 9

Please

give

the

key.

Ref 10

Could

you

give

the

key?

Ref 11

would

get

the

key.

Ref 12

The

key,

please.

Ref 13

May

have

the

key,

please?

Ref 14

Could

you

give

the

key,

please?

Ref 15

Could

you

pass

the

key,

please?

Output 0

can

have

the

key?

N-grams

I	can	have	the	key?
I		have	the	key?
		have the
			the key?

Output 1

can

have

key

N-grams

i	can	have	key	?
		have	key

Output 2

can

have

key?

N-grams

I	can	have	key?
I		have	key?

Output 3

Can

have

key?

N-grams

Can	I	have	key?
Can	I	have	key?
Can I
Can I have
	I have

Output 4

can

have

the

key?

N-grams

I	can	have	the	key?
I		have	the	key?
		have the
			the key?

Sentence 470) BLEU: 0 (1/0/0/0) ; 0 (0.6667/0.5/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0)

Source

�A

��

�W�r

�H

Ref 0

And

your

name?

Ref 1

What's

your

name?

Ref 2

And,

your

name

please.

Ref 3

And,

please

tell

your

name.

Ref 4

So,

your

name?

Ref 5

And,

what's

your

name?

Ref 6

Then,

your

name,

please?

Ref 7

Also,

what's

your

name?

Ref 8

Then,

please

give

your

name.

Ref 9

Your

name,

too,

please.

Ref 10

Next,

your

name.

Ref 11

And

what

your

name?

Ref 12

question.

Your

name

please.

Ref 13

Who

calling?

Ref 14

May

ask

for

your

name?

Ref 15

And

may

inquire

who

calling?

Output 0

Your

name?

N-grams

Your	name?
Your	name?

Output 1

your

name

N-grams

your	name	?
your	name
your name

Output 2

Your

name?

N-grams

Your	name?
Your	name?

Output 3

Your

name?

N-grams

Your	name?
Your	name?

Output 4

Your

name?

N-grams

Your	name?
Your	name?

Sentence 471) BLEU: 0 (1/0/0/0) ; 0 (0.5/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0)

Source

�{��

�C

Ref 0

Cash.

Ref 1

cash.

Ref 2

will

pay

with

cash.

Ref 3

use

cash

pay.

Ref 4

cash.

Ref 5

cash.

Ref 6

will

cash.

Ref 7

cash.

Ref 8

cash.

Ref 9

With

cash.

Ref 10

cash.

Ref 11

I'll

pay

cash.

Ref 12

Here's

some

cash.

Ref 13

cash.

Ref 14

cash.

Ref 15

It's

cash.

Output 0

Cash.

N-grams

Cash.

Output 1

cash

N-grams

cash	.
cash

Output 2

Cash.

N-grams

Cash.

Output 3

Cash.

N-grams

Cash.

Output 4

Cash.

N-grams

Cash.

Sentence 472) BLEU: 0.2778 (0.5/0.3333/0.25/0.1429) ; 0 (0.1111/0/0/0) ; 0 (0.5/0.2857/0.1667/0) ; 0.2778 (0.5/0.3333/0.25/0.1429) ; 0 (0.5/0.1111/0/0)

Source

��

�O

�a

�F

�޲z

�C

��

�i�H

�i��

��

�H

Ref 0

This

housekeeping.

May

come

in?

Ref 1

This

housekeeping.

you

mind

come

in?

Ref 2

Housekeeping.

Can

come

in?

Ref 3

Housekeeping.

mind

come

in?

Ref 4

Housekeeping.

Can

come

in?

Ref 5

It's

housekeeping.

come

in?

Ref 6

I'm

from

housekeeping.

May

enter?

Ref 7

Cleaning.

Can

enter?

Ref 8

It's

housekeeping.

alright

come

in?

Ref 9

Cleaning

here.

you

mind

enter?

Ref 10

Housekeeping

staff.

you

mind

come

in?

Ref 11

Here

clean

the

room.

Would

okay

come

in?

Ref 12

Cleaning

staff.

May

enter?

Ref 13

Housekeeping

service.

May

enter?

Ref 14

This

the

cleaning

service.

alright

come

in?

Ref 15

Housekeeping.

May

enter

the

room?

Output 0

home

economics

management.

Can

come

in?

N-grams

I	am	a	home	economics	management.	Can	I	come	in?
I						Can	I come		in?
						Can I		come
						Can I come
						Can I come in?
							I come in?
								come in?

Output 1

home

economics

management

come

N-grams

i	home	economics	management	i	come	in	am	?
					come

Output 2

was

home

economics

management.

come

in?

N-grams

I	was	home	economics	management.	I	come	in?
I					I come		in?
					I come in?
						come
						come in?

Output 3

home

economics

management.

Can

come

in?

N-grams

I	am	a	home	economics	management.	Can	I	come	in?
I						Can	I come		in?
						Can I		come
						Can I come
						Can I come in?
							I come in?
								come in?

Output 4

the

household

management

management.

may

come

in?

N-grams

I	am	the	household	management	management.	I	may	come	in?
I		the						come	in?
								come in?

Sentence 473) BLEU: 0.6316 (0.8182/0.7/0.5556/0.5) ; 0 (0.5455/0.1/0/0) ; 0 (0.5556/0.25/0/0) ; 0.317 (0.7273/0.5/0.2222/0.125) ; 0.6316 (0.8182/0.7/0.5556/0.5)

Source

��

�ݭn

�b

�ɤW

�b

�h��

��

�H

Ref 0

How

many

days

have

stay

bed?

Ref 1

How

many

days

will

have

bedridden?

Ref 2

How

many

days

have

stay

bed?

Ref 3

How

many

days

will

have

recuperate?

Ref 4

How

many

days

will

have

rest?

Ref 5

How

many

days

need

rest?

Ref 6

How

many

days

will

have

stay

quiet?

Ref 7

How

many

days

must

stay

bed?

Ref 8

How

many

days

necessary

for

rest?

Ref 9

How

many

days

you

require

that

rest?

Ref 10

For

how

many

days

supposed

lie

bed?

Ref 11

How

many

days

should

rest

for?

Ref 12

How

many

days'

bed-rest

need?

Ref 13

How

many

days

must

rest

bed?

Ref 14

How

many

days

required

stay

bed?

Ref 15

How

many

days

confined

bed?

Output 0

How

many

days

need

stay

the

bed?

N-grams

How	many	days	do	I	need	to	stay	on	the	bed?
How	many	days	do	I	need	to	stay			bed?
How many		days do		I need		to stay
How many days			do I		need to
How many days do				I need to
	many days		do I need
	many days do
	many days do I
		days do I
		days do I need
			do I need to

Output 1

need

the

days

bed

how

many

N-grams

i	need	the	days	bed	how	many	do	to	on	?
	need		days		how	many	do	to
					how many

Output 2

need

the

number

days

spent

bed?

N-grams

I	need	the	number	of	days	spent	in	bed?
I	need				days		in	bed?
I need							in bed?

Output 3

How

many

need

foolish

the

bed?

N-grams

How	many	do	I	need	to	be	foolish	on	the	bed?
How	many	do	I	need	to	be				bed?
How many		do I		need to
		do I need			to be
		do I need to
			I need
			I need to

Output 4

How

many

days

need

stay

the

bed?

N-grams

How	many	days	do	I	need	to	stay	on	the	bed?
How	many	days	do	I	need	to	stay			bed?
How many		days do		I need		to stay
How many days			do I		need to
How many days do				I need to
	many days		do I need
	many days do
	many days do I
		days do I
		days do I need
			do I need to

Sentence 474) BLEU: 0 (1/1/0.6667/0) ; 0 (0.1667/0/0/0) ; 0 (1/1/0.6667/0) ; 0 (0.8/0.5/0.3333/0) ; 0 (0.5/0/0/0)

Source

��

�ϥ�

�Ȧ�

�䲼

��

�H

Ref 0

Can

use

traveller's

checks?

Ref 1

you

take

traveler's

checks?

Ref 2

Can

pay

traveler's

checks?

Ref 3

you

traveler's

checks?

Ref 4

Can

pay

traveler's

check?

Ref 5

May

use

traveler's

checks?

Ref 6

use

traveler's

checks?

Ref 7

okay

use

traveler's

checks?

Ref 8

Can

pay

traveler's

checks?

Ref 9

Are

traveler's

checks

okay

use?

Ref 10

May

use

traveller's

checks?

Ref 11

Would

okay

pay

with

traveller's

checks?

Ref 12

Are

traveller's

checks

accepted

here?

Ref 13

Can

pay

traveler's

check?

Ref 14

Can

use

traveler's

checks?

Ref 15

Can

pay

for

traveler's

check?

Output 0

Can

use

traveler's

checks?

N-grams

Can	I	use	traveler's	checks?
Can	I	use	traveler's	checks?
Can I		use traveler's
Can I use			traveler's checks?
	I use
		use traveler's checks?

Output 1

can

use

check

N-grams

can	i	use	's	check	?
		use

Output 2

Can

use

traveler's

checks?

N-grams

Can	I	use	traveler's	checks?
Can	I	use	traveler's	checks?
Can I		use traveler's
Can I use			traveler's checks?
	I use
		use traveler's checks?

Output 3

Can

use

trip

check?

N-grams

Can	I	use	trip	check?
Can	I	use		check?
Can I
Can I use
	I use

Output 4

can

use

the

traller's

check?

N-grams

I	can	use	the	traller's	check?
I		use			check?

Sentence 475) BLEU: 0 (0.6667/0/0/0) ; 0 (0.25/0/0/0) ; 0 (0.6/0/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.8333/0.4/0.25/0)

Source

��

�S��

��

�W

�C

Ref 0

don't

have

middle

name.

Ref 1

have

middle

name.

Ref 2

haven't

got

middle

name.

Ref 3

have

middle

name.

Ref 4

haven't

got

middle

name.

Ref 5

parents

didn't

give

middle

name.

Ref 6

have

middle

name.

Ref 7

not

possess

middle

name.

Ref 8

wasn't

given

middle

name.

Ref 9

have

middle

name.

Ref 10

don't

have

second

name.

Ref 11

haven't

got

middle

name.

Ref 12

don't

have

second

given

name.

Ref 13

only

have

one

given

name.

Ref 14

was

not

given

middle

name.

Ref 15

don't

have

middle

name.

Output 0

didn't

win.

N-grams

I	didn't	win.
I	didn't

Output 1

not

name

N-grams

i	not	name	.
	not

Output 2

not

name.

N-grams

I	am	not	in	name.
I		not		name.

Output 3

didn't

win.

N-grams

I	didn't	win.
I	didn't

Output 4

not

have

the

name.

N-grams

I	do	not	have	the	name.
I	do	not	have		name.
I do
I do not
	do not

Sentence 476) BLEU: 0.3303 (0.6667/0.375/0.2857/0.1667) ; 0 (0.7143/0.3333/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.5/0.2222/0.125/0) ; 0 (0.625/0.4286/0.1667/0)

Source

�Ǫ��~�T��

��I��

�b

��

�H

Ref 0

Where

the

Greyhound

bus

terminal?

Ref 1

Where

the

Greyhound

bus

terminal

located?

Ref 2

Where

can

find

the

Greyhound

bus

terminal?

Ref 3

you

know

where

the

Greyhound

bus

terminal

is?

Ref 4

Where

the

Greyhound

bus

station?

Ref 5

Where

would

the

Greyhound

station

be?

Ref 6

Where

the

terminal

for

the

Greyhound

bus?

Ref 7

Where

can

find

the

Greyhound

bus

terminal?

Ref 8

Where

the

Greyhound

bus

terminal

situated?

Ref 9

Where

would

the

Greyhound

bus

terminal

be?

Ref 10

Where

the

bus

terminal

for

Greyhound

buses?

Ref 11

Where

Greyhound

buses

leave

from?

Ref 12

Where

can

get

Greyhound

bus?

Ref 13

Where

can

catch

the

Greyhound

bus?

Ref 14

Where

the

Greyhound

Bus

station?

Ref 15

Where

can

find

the

Greyhound

Bus

station?

Output 0

Where

the

Greyhound

long

distance

car

terminal

station?

N-grams

Where	is	the	Greyhound	long	distance	car	terminal	station?
Where	is	the	Greyhound				terminal	station?
Where is		the Greyhound
Where is the
Where is the Greyhound
	is the
	is the Greyhound

Output 1

greyhound

bus

terminal

where

the

N-grams

greyhound	bus	terminal	where	is	the	?
	bus	terminal	where	is	the
	bus terminal			is the

Output 2

Greyhound

Bus

Terminal

where?

N-grams

Greyhound	Bus	Terminal	where?
Greyhound	Bus
Greyhound Bus

Output 3

Where

the

greyhound

long

distance

car

terminal

station

N-grams

Where	is	the	greyhound	long	distance	car	terminal	station	?
Where	is	the					terminal	station
Where is
Where is the
	is the

Output 4

Where

the

Grayhound

long-distance

bus

terminal

at?

N-grams

Where	is	the	Grayhound	long-distance	bus	terminal	at?
Where	is	the			bus	terminal
Where is					bus terminal
Where is the
	is the

Sentence 477) BLEU: 0.4317 (0.7778/0.625/0.4286/0.1667) ; 0 (0.5/0/0/0) ; 0.4317 (0.7778/0.625/0.4286/0.1667) ; 0 (0.125/0/0/0) ; 0 (0.625/0/0/0)

Source

��

�R

��

�M

�o

�̭�

��

��O

�@��

��

�C

Ref 0

What

bought

and

what

inside

not

the

same.

Ref 1

The

contents

inside

are

not

what

bought.

Ref 2

What

bought

not

the

same

what

inside.

Ref 3

What

bought

different

than

the

contents.

Ref 4

The

item

purchased

and

the

item

inside

different.

Ref 5

The

item

bought

different

from

what's

inside.

Ref 6

The

item

inside

not

what

purchased.

Ref 7

What

purchased

and

the

contents

not

correspond.

Ref 8

What

purchased

and

what's

inside

are

two

different

things.

Ref 9

What

paid

for

and

what

got

are

different.

Ref 10

There's

difference

between

what

bought

and

what's

inside.

Ref 11

What

bought

and

its

contents

are

different.

Ref 12

The

contents

are

different

from

what

thought

had

bought.

Ref 13

The

item

purchased

and

what

was

actually

inside

different.

Ref 14

received

different

item

inside

than

what

actually

purchased.

Ref 15

got

something

different

inside

than

what

really

purchased.

Output 0

bought

and

that

there

not

the

same.

N-grams

I	bought	and	that	there	is	not	the	same.
I	bought	and			is	not	the	same.
I bought					is not		the same.
I bought and					is not the
	bought and				is not the same.
						not the
						not the same.

Output 1

and

not

same

buy

N-grams

i	and	not	same	buy	.
	and	not	same

Output 2

bought

and

that

there

not

the

same.

N-grams

I	bought	and	that	there	is	not	the	same.
I	bought	and			is	not	the	same.
I bought					is not		the same.
I bought and					is not the
	bought and				is not the same.
						not the
						not the same.

Output 3

buy

with

isn't

similar.

N-grams

I	buy	of	with	my	of	isn't	similar.
I

Output 4

buy

and

inside

this

not

same.

N-grams

I	buy	and	inside	this	am	not	same.
I		and	inside			not	same.

Sentence 478) BLEU: 0 (1/1/1/0) ; 0 (0.25/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.375/0/0/0) ; 0 (1/1/1/0)

Source

��

�Pı

�S�르��

��

�C

Ref 0

feel

languid.

Ref 1

feel

sluggish.

Ref 2

don't

feel

well.

Ref 3

feel

listless.

Ref 4

feel

lethargic.

Ref 5

body

feels

tired.

Ref 6

feel

enervated.

Ref 7

I'm

feeling

lethargic.

Ref 8

body

feels

heavy.

Ref 9

have

energy.

Ref 10

feel

tired.

Ref 11

I'm

drained.

Ref 12

body

feels

tired.

Ref 13

feel

sluggish.

Ref 14

body

feels

dull.

Ref 15

feel

lethargic.

Output 0

feel

listless.

N-grams

I	feel	listless.
I	feel	listless.
I feel
I feel listless.
	feel listless.

Output 1

feel

the

N-grams

i	feel	the	.
	feel

Output 2

feel

the

slouch.

N-grams

I	feel	the	slouch.
I	feel
I feel

Output 3

feeling

has

the

Jing

beat

Cai.

N-grams

My	feeling	has	no	the	Jing	beat	Cai.
My	feeling		no

Output 4

feel

listless.

N-grams

I	feel	listless.
I	feel	listless.
I feel
I feel listless.
	feel listless.

Sentence 479) BLEU: 0.4111 (0.75/0.5714/0.3333/0.2) ; 0 (0.5556/0.125/0/0) ; 0.4111 (0.75/0.5714/0.3333/0.2) ; 0 (0.6/0.3333/0.125/0) ; 0.4273 (0.875/0.5714/0.3333/0.2)

Source

��

�w��

�C

��

�W�r

�O

��

�C

Ref 0

have

reservation.

name

Yamada.

Ref 1

name

Yamada

and

have

reservation.

Ref 2

name

Yamada

and

made

reservation.

Ref 3

have

reservation

under

Yamada.

Ref 4

name's

Yamada

and

have

reservation.

Ref 5

I'm

Yamada

and

made

reservation.

Ref 6

It's

Yamada

and

I've

got

reservation.

Ref 7

have

reservations

under

Yamada.

Ref 8

name

Yamada

and

I've

made

reservations.

Ref 9

Reservations

have

been

made

under

name,

Yamada.

Ref 10

made

reservation.

Yamada.

Ref 11

There

reservation

under

name.

It's

under

Yamada.

Ref 12

reservation

was

made

under

name,

Yamada.

Ref 13

made

reservation.

name

Yamada.

Ref 14

reserved

under

the

name,

Yamada.

Ref 15

have

reservation

the

name

Yamada.

Output 0

have

appointment.

name

Yamada.

N-grams

I	have	an	appointment.	My	name	is	Yamada.
I	have			My	name	is	Yamada.
I have				My name		is Yamada.
				My name is
				My name is Yamada.
					name is
					name is Yamada.

Output 1

have

appointment

name

yamada

the

N-grams

i	have	appointment	my	name	is	yamada	the	.
	have		my	name	is		the
				name is

Output 2

have

appointment.

name

Yamada.

N-grams

I	have	an	appointment.	My	name	is	Yamada.
I	have			My	name	is	Yamada.
I have				My name		is Yamada.
				My name is
				My name is Yamada.
					name is
					name is Yamada.

Output 3

have

already

reserved.

name

the

��

N-grams

I	have	already	reserved.	My	name	is	the	��	.
I	have			My	name	is	the
I have				My name
				My name is
					name is

Output 4

have

the

appointment.

name

Yamada.

N-grams

I	have	the	appointment.	My	name	is	Yamada.
I	have	the		My	name	is	Yamada.
I have				My name		is Yamada.
				My name is
				My name is Yamada.
					name is
					name is Yamada.

Sentence 480) BLEU: 0 (0.8/0.75/0.6667/0) ; 0 (0.6/0.5/0.3333/0) ; 0 (0.8/0.75/0.6667/0) ; 0 (0.8/0.75/0.6667/0) ; 0 (0.8/0.75/0.6667/0)

Source

��

�@��

��h��

�C

Ref 0

Give

some

anodyne,

please.

Ref 1

Some

painkiller,

please.

Ref 2

Give

some

painkiller,

please.

Ref 3

Painkiller,

please.

Ref 4

Please

give

painkiller.

Ref 5

Can

get

painkiller,

please?

Ref 6

Could

you

give

some

kind

painkiller?

Ref 7

Would

you

give

painkiller,

please?

Ref 8

I'd

painkiller,

please.

Ref 9

want

get

painkiller,

please.

Ref 10

Could

have

some

anodyne.

Ref 11

Some

anodyne,

please.

Ref 12

would

some

anodyne.

Ref 13

would

some

painkillers,

please.

Ref 14

Please

give

analgesic.

Ref 15

would

pain

reliever,

please.

Output 0

Please

give

some

painkillers.

N-grams

Please	give	me	some	painkillers.
Please	give	me	some
Please give		me some
Please give me
	give me
	give me some

Output 1

please

give

some

N-grams

please	give	me	some	.
	give	me	some
	give me
	give me some
		me some

Output 2

Please

give

some

painkillers.

N-grams

Please	give	me	some	painkillers.
Please	give	me	some
Please give		me some
Please give me
	give me
	give me some

Output 3

Please

give

some

analgesics.

N-grams

Please	give	me	some	analgesics.
Please	give	me	some
Please give		me some
Please give me
	give me
	give me some

Output 4

Please

give

some

mitigatives.

N-grams

Please	give	me	some	mitigatives.
Please	give	me	some
Please give		me some
Please give me
	give me
	give me some

Sentence 481) BLEU: 1 (1/1/1/1) ; 0 (0.6/0/0/0) ; 1 (1/1/1/1) ; 1 (1/1/1/1) ; 0 (0.8/0.5/0.3333/0)

Source

�A

�b

��

�u�@

�H

Ref 0

Where

are

you

working?

Ref 1

Where

are

you

working

at?

Ref 2

Where

the

place

you

are

working?

Ref 3

Where

you

work?

Ref 4

Where

you

work?

Ref 5

Where

are

you

employed?

Ref 6

What

place

you

work

at?

Ref 7

Where

you

work?

Ref 8

Whereabouts

you

work?

Ref 9

Where

you

work?

Ref 10

Where's

your

work

place?

Ref 11

Where

you

work?

Ref 12

which

company

you

work?

Ref 13

Where

you

work?

Ref 14

Where

are

you

employed?

Ref 15

Where

your

job

located?

Output 0

Where

you

work?

N-grams

Where	do	you	work?
Where	do	you	work?
Where do		you work?
Where do you
Where do you work?
	do you
	do you work?

Output 1

where

you

work

N-grams

where	you	do	work	?
	you	do	work

Output 2

Where

are

you

working?

N-grams

Where	are	you	working?
Where	are	you	working?
Where are		you working?
Where are you
Where are you working?
	are you
	are you working?

Output 3

Where

you

work?

N-grams

Where	do	you	work?
Where	do	you	work?
Where do		you work?
Where do you
Where do you work?
	do you
	do you work?

Output 4

Where

you

work?

N-grams

Where	do	you	in	work?
Where	do	you		work?
Where do
Where do you
	do you

Sentence 482) BLEU: 0.726 (0.7778/0.75/0.7143/0.6667) ; 0 (0.5714/0.1667/0/0) ; 0.726 (0.7778/0.75/0.7143/0.6667) ; 0 (0.4545/0.2/0.1111/0) ; 0 (0.6667/0.25/0.1429/0)

Source

��

�b

��

�@

��

�p��

��

�滷��

�H

Ref 0

Where

can

rent

pair

opera

glasses?

Ref 1

Where

place

where

can

rent

pair

opera

glasses?

Ref 2

Where

can

rent

pair

opera

glasses?

Ref 3

you

know

where

can

rent

pair

opera

glasses?

Ref 4

Where

could

rent

some

opera

glasses?

Ref 5

Where

they

rent

opera

glasses?

Ref 6

Where's

the

place

that

rents

opera

glasses?

Ref 7

Where

would

possible

rent

some

opera

glasses?

Ref 8

you

know

where

could

rent

some

opera

glasses?

Ref 9

Where

they

rent

opera

glasses?

Ref 10

Where

possible

rent

pair

opera

glasses?

Ref 11

Where

can

get

pair

opera

glasses?

Ref 12

Could

you

tell

where

can

find

opera

glasses?

Ref 13

Where

may

rent

some

opera

glasses?

Ref 14

Where

are

rentals

for

opera

glasses

available?

Ref 15

Where

may

rent

opera

glasses?

Output 0

Where

can

rent

pair

small

binoculars?

N-grams

Where	can	I	rent	a	pair	of	small	binoculars?
Where	can	I	rent	a	pair	of
Where can		I rent		a pair
Where can I			rent a		pair of
Where can I rent				a pair of
	can I		rent a pair
	can I rent
	can I rent a
		I rent a
		I rent a pair
			rent a pair of

Output 1

where

can

rent

small

N-grams

where	can	i	rent	a	small	?
where	can		rent	a
			rent a

Output 2

Where

can

rent

pair

small

binoculars?

N-grams

Where	can	I	rent	a	pair	of	small	binoculars?
Where	can	I	rent	a	pair	of
Where can		I rent		a pair
Where can I			rent a		pair of
Where can I rent				a pair of
	can I		rent a pair
	can I rent
	can I rent a
		I rent a
		I rent a pair
			rent a pair of

Output 3

where

can

rent

vice-

small

scaled

double

eyes

telescope?

N-grams

I	where	can	rent	a	vice-	small	scaled	double	eyes	telescope?
I	where	can	rent	a
		can rent
		can rent a
			rent a

Output 4

Where

can

rent

small

binocular?

N-grams

Where	can	I	in	rent	to	a	small	binocular?
Where	can	I		rent	to	a
Where can
Where can I
	can I

Sentence 483) BLEU: 0.7071 (1/0.75/0.6667/0.5) ; 0 (0.6667/0.2/0/0) ; 0.7071 (1/0.75/0.6667/0.5) ; 0.5373 (0.8333/0.6/0.5/0.3333) ; 0 (0.5/0.1429/0/0)

Source

��

��@�T��

�h

��

�H

Ref 0

What

about

going

bus?

Ref 1

How

about

going

bus?

Ref 2

What

you

think

about

going

bus?

Ref 3

How

you

feel

about

going

bus?

Ref 4

How

about

taking

bus?

Ref 5

What

would

you

think

traveling

bus?

Ref 6

What

about

taking

bus?

Ref 7

What

you

think

going

bus?

Ref 8

How

about

getting

there

bus?

Ref 9

Would

you

consider

taking

the

bus?

Ref 10

How

about

taking

the

bus?

Ref 11

Would

okay

bus?

Ref 12

What

you

think

about

going

bus?

Ref 13

How

about

going

bus?

Ref 14

How

about

taking

bus

there?

Ref 15

How

about

going

there

bus?

Output 0

How

bus?

N-grams

How	to	go	by	bus?
How	to	go	by	bus?
	to go		by bus?
	to go by
	to go by bus?
		go by
		go by bus?

Output 1

how

bus

the

N-grams

how	to	go	bus	the	?
	to	go	bus	the
	to go

Output 2

How

bus?

N-grams

How	to	go	by	bus?
How	to	go	by	bus?
	to go		by bus?
	to go by
	to go by bus?
		go by
		go by bus?

Output 3

How

about

taking

the

bus

to?

N-grams

How	about	taking	the	bus	to?
How	about	taking	the	bus
How about		taking the
How about taking
How about taking the
	about taking
	about taking the

Output 4

Rides

the

bus

what

kind

of?

N-grams

Rides	the	bus	to	go	what	kind	of?
	the	bus	to	go
			to go

Sentence 484) BLEU: 0.5969 (0.8889/0.75/0.5714/0.3333) ; 0 (0.625/0.2857/0/0) ; 0.5969 (0.8889/0.75/0.5714/0.3333) ; 0 (0.6364/0.4/0.1111/0) ; 0 (0.6667/0.25/0/0)

Source

��

�b

��

�R��

�h

�ܢ��

��

��@�T��

��

�H

Ref 0

Where

can

buy

bus

ticket

Napa?

Ref 1

Where

can

buy

bus

ticket

Napa?

Ref 2

Where

place

where

can

buy

bus

ticket

for

Napa?

Ref 3

you

know

where

can

buy

bus

ticket

for

Napa?

Ref 4

Where

would

able

get

bus

ticket

for

Napa?

Ref 5

Where

could

get

ticket

for

bus

Napa?

Ref 6

Where

can

purchase

ticket

for

bus

Napa?

Ref 7

Where

are

bus

tickets

Napa

sold?

Ref 8

Where

possible

get

bus

ticket

Napa?

Ref 9

Where

would

get

bus

ticket

Napa?

Ref 10

Where

are

the

tickets

Napa

sale?

Ref 11

Could

you

tell

where

buy

ticket

for

Napa?

Ref 12

Where

you

buy

bus

tickets

for

Napa?

Ref 13

Where

are

the

bus

tickets

Napa

sold?

Ref 14

Where

can

purchase

bus

ticket

get

Napa?

Ref 15

Where

may

get

ticket

for

the

bus

going

Napa?

Output 0

Where

can

buy

bus

ticket

Napa?

N-grams

Where	can	I	buy	my	bus	ticket	to	Napa?
Where	can	I	buy		bus	ticket	to	Napa?
Where can		I buy			bus ticket		to Napa?
Where can I					bus ticket to
Where can I buy					bus ticket to Napa?
	can I					ticket to
	can I buy					ticket to Napa?

Output 1

can

buy

bus

ticket

napa

the

N-grams

can	i	buy	bus	ticket	napa	the	?
can		buy	bus	ticket		the
		buy bus
			bus ticket

Output 2

Where

can

buy

bus

ticket

Napa?

N-grams

Where	can	I	buy	my	bus	ticket	to	Napa?
Where	can	I	buy		bus	ticket	to	Napa?
Where can		I buy			bus ticket		to Napa?
Where can I					bus ticket to
Where can I buy					bus ticket to Napa?
	can I					ticket to
	can I buy					ticket to Napa?

Output 3

Which

can

buy

the

bus

ticket

the

�ܢ��

at?

N-grams

Which	can	I	buy	the	bus	ticket	of	the	�ܢ��	at?
	can	I	buy	the	bus	ticket
	can I			the bus
	can I buy				bus ticket
		I buy

Output 4

How

can

buy

Napa

the

bus

ticket?

N-grams

How	can	I	in	buy	Napa	the	bus	ticket?
	can	I		buy	Napa	the	bus
	can I					the bus

Sentence 485) BLEU: 0.5491 (0.75/0.5455/0.5/0.4444) ; 0 (0.7/0.4444/0.25/0) ; 0.5491 (0.75/0.5455/0.5/0.4444) ; 0.3672 (0.75/0.3636/0.3/0.2222) ; 0.239 (0.5385/0.3333/0.1818/0.1)

Source

��

��W

�S��

��

�h

�R

�@

�i

�s

��

�C

Ref 0

don't

have

enough

money

with

buy

new

airplane

ticket.

Ref 1

don't

have

enough

money

purchase

new

airplane

ticket.

Ref 2

new

plane

ticket

will

cost

than

what

I've

got

me.

Ref 3

haven't

got

enough

cover

the

cost

new

airplane

ticket.

Ref 4

haven't

got

enough

money

buy

new

airline

ticket.

Ref 5

don't

have

enough

money

purchase

new

plane

ticket.

Ref 6

I'm

not

carrying

enough

money

with

get

new

plane

ticket.

Ref 7

I'm

not

carrying

enough

money

get

new

plane

ticket.

Ref 8

There's

not

enough

money

here

for

new

plane

ticket.

Ref 9

just

don't

have

enough

funds

pay

for

another

air

ticket.

Ref 10

have

money

now

buy

new

plane

ticket.

Ref 11

haven't

got

the

money

buy

new

air

ticket.

Ref 12

haven't

enough

money

buy

new

flight

ticket.

Ref 13

didn't

bring

enough

money

with

buy

new

airplane

ticket.

Ref 14

don't

have

enough

money

buy

another

airplane

ticket.

Ref 15

don't

have

the

financial

resources

get

new

airplane

ticket.

Output 0

body

did

not

have

enough

money

buy

new

ticket.

N-grams

My	body	did	not	have	enough	money	to	buy	a	new	ticket.
			not	have	enough	money	to	buy	a	new	ticket.
				have enough		money to		buy a
				have enough money			to buy		a new
				have enough money to				buy a new
					enough money		to buy a
					enough money to
					enough money to buy
						money to buy
						money to buy a
							to buy a new

Output 1

body

not

enough

money

buy

new

ticket

N-grams

my	body	not	enough	money	buy	a	new	ticket	.
		not	enough	money	buy	a	new	ticket
		not enough			buy a
		not enough money			buy a new
			enough money			a new

Output 2

body

did

not

have

enough

money

buy

new

ticket.

N-grams

My	body	did	not	have	enough	money	to	buy	a	new	ticket.
			not	have	enough	money	to	buy	a	new	ticket.
				have enough		money to		buy a
				have enough money			to buy		a new
				have enough money to				buy a new
					enough money		to buy a
					enough money to
					enough money to buy
						money to buy
						money to buy a
							to buy a new

Output 3

body

has

enough

money

buy

new

airplane

ticket.

N-grams

My	body	has	no	enough	of	money	buy	a	new	airplane	ticket.
			no	enough	of	money	buy	a	new	airplane	ticket.
							buy a		new airplane
							buy a new			airplane ticket.
							buy a new airplane
								a new
								a new airplane
								a new airplane ticket.
									new airplane ticket.

Output 4

body

not

fully

��

the

money

buys

new

plane

ticket.

N-grams

body

not

fully

��

the

money

buys

new

plane

ticket.

not

the

money

new

plane

ticket.

the money

a new

plane ticket.

a new plane

a new plane ticket.

new plane

new plane ticket.

Sentence 486) BLEU: 0 (0.5556/0.25/0.1429/0) ; 0.3689 (0.7778/0.5/0.2857/0.1667) ; 0 (0.5556/0.25/0.1429/0) ; 0 (0.625/0.2857/0/0) ; 0.3549 (0.6667/0.5/0.2857/0.1667)

Source

�A

��

�B�N�O

�W

�Q

�n

�X

��

�p�c

�H

Ref 0

How

many

scoops

ice

cream

you

want

your

cone?

Ref 1

How

many

scoops

would

you

your

cone?

Ref 2

your

cone,

how

many

scoops

ice

cream

would

you

like?

Ref 3

How

many

scoops

ice

cream

would

you

have

your

cone?

Ref 4

How

many

scoops

was

that

for

your

ice

cream

cone?

Ref 5

You'd

cone

with

how

many

scoops

ice

cream?

Ref 6

How

many

scoops

ice

cream

your

cone?

Ref 7

How

many

scoops

ice

cream

would

you

your

cone?

Ref 8

How

many

scoops

ice

cream

will

you

having

your

cone?

Ref 9

How

many

scoops

ice

cream

are

you

getting

your

cone?

Ref 10

How

many

scoops

your

cone?

Ref 11

How

many

scoops

ice-cream

you

want

put

your

cone?

Ref 12

So,

that

will

how

many

scoops

with

your

cone?

Ref 13

How

many

scoops

would

you

your

ice

cream

cone?

Ref 14

How

much

ice

cream

would

you

scooped

onto

your

cone?

Ref 15

How

many

scoops

can

get

you?

Output 0

You

want

few

teaspoons

ice

cream

on?

N-grams

You	want	a	few	teaspoons	of	ice	cream	on?
	want	a			of	ice	cream
					of ice
					of ice cream
						ice cream

Output 1

want

ice

cream

your

how

many

small

N-grams

want	ice	cream	on	your	how	many	small	?
want	ice	cream	on	your	how	many
	ice cream		on your		how many
	ice cream on
	ice cream on your
		cream on
		cream on your

Output 2

You

want

few

teaspoons

ice

cream

on?

N-grams

You	want	a	few	teaspoons	of	ice	cream	on?
	want	a			of	ice	cream
					of ice
					of ice cream
						ice cream

Output 3

Want

your

ice-cream

how

many

small

Shaos?

N-grams

Want	on	your	ice-cream	how	many	small	Shaos?
	on	your	ice-cream	how	many
	on your			how many

Output 4

How

many

small

buckets

your

ice

cream

wants?

N-grams

How	many	small	buckets	on	your	ice	cream	wants?
How	many			on	your	ice	cream
How many				on your		ice cream
				on your ice
				on your ice cream
					your ice
					your ice cream

Sentence 487) BLEU: 0.8409 (1/0.8333/0.8/0.75) ; 0.3457 (0.5/0.4286/0.3333/0.2) ; 0.5373 (0.7/0.5556/0.5/0.4286) ; 0.8409 (0.875/0.8571/0.8333/0.8) ; 0.8409 (1/0.8333/0.8/0.75)

Source

�藍�_

�A

��

�Q

�}

�@

��

�C

Ref 0

Excuse

me,

want

open

account.

Ref 1

Excuse

me,

but

want

open

new

account.

Ref 2

Excuse

me,

but

want

create

account.

Ref 3

Excuse

me,

but

I'd

open

account.

Ref 4

Excuse

but

I'd

start

account.

Ref 5

Sorry,

but

want

open

account.

Ref 6

Pardon

me,

I'd

get

account.

Ref 7

Pardon

me,

I'd

open

account.

Ref 8

Excuse

me,

wish

open

account.

Ref 9

Excuse

me,

could

open

account,

please?

Ref 10

I'm

sorry,

would

open

account.

Ref 11

Sorry

bother

you,

but

I'm

interested

opening

account.

Ref 12

hope

I'm

not

disturbing

you.

I'm

enquiring

about

opening

account.

Ref 13

Excuse

me,

would

open

new

account.

Ref 14

Excuse

me,

would

start

account.

Ref 15

Excuse

me,

would

start

new

account.

Output 0

Sorry,

want

open

account.

N-grams

Sorry,	I	want	to	open	an	account.
Sorry,	I	want	to	open	an	account.
	I want		to open		an account.
	I want to			open an
	I want to open
		want to		open an account.
		want to open
		want to open an
			to open an
			to open an account.

Output 1

want

open

account

N-grams

i	,	want	to	open	an	account	.
		want	to	open	an
		want to		open an
		want to open
		want to open an
			to open
			to open an

Output 2

beg

your

pardon,

want

open

account.

N-grams

I	beg	your	pardon,	I	want	to	open	an	account.
I				I want		to	open	an	account.
				I want to			open an
				I want to open				an account.
					want	to open
					want to		open an account.
					want to open
					want to open an
						to open an
						to open an account.

Output 3

Execuse

me,

want

open

account.

N-grams

Execuse	me,	I	want	to	open	an	account.
	me,	I	want	to	open	an	account.
	me, I		want to		open an
	me, I want			to open		an account.
	me, I want to				open an account.
		I want		to open an
		I want to
		I want to open
			want to open
			want to open an
				to open an account.

Output 4

Sorry,

want

open

account.

N-grams

Sorry,	I	want	to	open	an	account.
Sorry,	I	want	to	open	an	account.
	I want		to open		an account.
	I want to			open an
	I want to open
		want to		open an account.
		want to open
		want to open an
			to open an
			to open an account.

Sentence 488) BLEU: 0 (0.3636/0/0/0) ; 0 (0.375/0/0/0) ; 0 (0.4167/0/0/0) ; 0 (0.2/0/0/0) ; 0 (0.3636/0/0/0)

Source

��

�@��

��

�A��

��

�]

��

�ө�

��

�H

Ref 0

Are

there

any

shops

which

sell

reasonably

priced

bags?

Ref 1

Are

there

any

shops

that

carry

reasonably

priced

bags?

Ref 2

you

know

any

shops

that

carry

reasonably

priced

bags?

Ref 3

Where

are

there

shops

with

reasonably

priced

bags?

Ref 4

Are

there

any

stores

that

have

bags

for

reasonable

price?

Ref 5

Are

there

any

shops

that

carry

fairly

cheap

bags?

Ref 6

Are

there

any

shops

that

sell

bags

that

don't

cost

arm

and

leg?

Ref 7

you

know

any

shops

that

sell

bags

that

are

reasonably

priced?

Ref 8

Would

there

happen

any

mid-price

range

bag

shops?

Ref 9

Could

you

tell

there

are

any

shops

selling

mid-price

range

bags?

Ref 10

Are

there

shops

where

can

buy

bags

reasonable

prices?

Ref 11

which

shops

can

buy

reasonable

priced

bags?

Ref 12

Which

shops

sell

bags

affordable

prices?

Ref 13

Are

there

any

store

that

carry

affordably

priced

bags?

Ref 14

Are

there

any

shops

that

have

affordable

bags?

Ref 15

there

shop

that

carries

affordable

bags?

Output 0

There

some

prices

suitably

sell

package

store?

N-grams

There	is	some	prices	suitably	to	sell	a	package	of	store?
					to	sell	a		of

Output 1

there

some

price

package

store

N-grams

there	some	of	price	package	store	is	?
there		of			store

Output 2

There

have

some

the

selling

price

appropriate

package

store?

N-grams

There	have	some	of	the	selling	price	of	an	appropriate	package	store?
	have		of		selling			an

Output 3

There

some

price

there

adequacy

pack

seller's

store?

N-grams

There	is	some	price	there	adequacy	of	pack	seller's	store?
				there		of

Output 4

There

some

prices

suitably

sell

package

store?

N-grams

There	is	some	prices	suitably	to	sell	a	package	of	store?
					to	sell	a		of

Sentence 489) BLEU: 0.7801 (0.9167/0.9091/0.8/0.5556) ; 0 (0.5556/0.375/0/0) ; 0.7801 (0.9167/0.9091/0.8/0.5556) ; 0 (0.5/0.2727/0.1/0) ; 0 (0.5/0.1818/0/0)

Source

��

�X��

��

�n

�h��

��

�H

Ref 0

How

much

does

cost

get

the

restaurant

taxi?

Ref 1

the

restaurant

taxi,

how

much

does

cost?

Ref 2

How

much

the

restaurant

taxi?

Ref 3

How

much

taxi

the

restaurant?

Ref 4

that

restaurant

cab,

how

much

would

be?

Ref 5

How

much

would

the

fare

take

taxi

that

restaurant?

Ref 6

How

much

would

run

take

cab

from

here

that

restaurant?

Ref 7

taxi,

what

does

cost

get

the

restaurant?

Ref 8

How

much

taxi

the

restaurant?

Ref 9

How

much

does

taxi

charge

get

the

restaurant?

Ref 10

How

much

would

get

the

restaurant

taxi?

Ref 11

What

would

the

taxi

fare

that

restaurant?

Ref 12

How

much

would

the

taxi

fare

that

restaurant?

Ref 13

taxi,

how

much

would

cost

the

restaurant?

Ref 14

How

would

taxi

cost

get

the

restaurant?

Ref 15

How

much

would

take

ride

cab

the

restaurant?

Output 0

How

much

does

cost

take

taxi

the

hotel?

N-grams

How	much	does	it	cost	to	take	a	taxi	to	the	hotel?
How	much	does	it	cost	to	take	a	taxi	to	the
How much		does it		cost to		take a		taxi to
How much does			it cost		to take		a taxi		to the
How much does it					to take a			taxi to the
	much does		it cost to			take a taxi
	much does it				to take a taxi
	much does it cost					take a taxi to
		does it cost					a taxi to
		does it cost to

Output 1

how

much

the

hotel

car

want

N-grams

how	much	to	to	the	hotel	car	want	?
how	much	to	to	the
how much			to the
	much to

Output 2

How

much

does

cost

take

taxi

the

hotel?

N-grams

How	much	does	it	cost	to	take	a	taxi	to	the	hotel?
How	much	does	it	cost	to	take	a	taxi	to	the
How much		does it		cost to		take a		taxi to
How much does			it cost		to take		a taxi		to the
How much does it					to take a			taxi to the
	much does		it cost to			take a taxi
	much does it				to take a taxi
	much does it cost					take a taxi to
		does it cost					a taxi to
		does it cost to

Output 3

Ride

rent

car

hotel

want

how

much

N-grams

Ride	rent	car	to	go	to	hotel	to	want	how	much	?
			to	go	to				how	much
			to go						how much
			to go to
				go to

Output 4

How

much

money

rides

the

rental

car

want

the

hotel?

N-grams

How	much	money	rides	the	rental	car	to	want	to	the	hotel?
How	much			the			to		to
How much									to the

Sentence 490) BLEU: 0.5373 (0.8333/0.6/0.5/0.3333) ; 0 (0.6/0/0/0) ; 0 (0.6667/0/0/0) ; 0.5373 (0.8333/0.6/0.5/0.3333) ; 0 (0.25/0/0/0)

Source

�o

��

��@�T��

��

�H

Ref 0

Where

does

this

bus

to?

Ref 1

What

the

destination

this

bus?

Ref 2

What

this

bus's

destination?

Ref 3

Where

does

this

bus

go?

Ref 4

Where

this

bus

heading?

Ref 5

What

the

destination

for

this

bus?

Ref 6

Where

this

bus

headed

for?

Ref 7

What

the

route

this

bus?

Ref 8

Can

you

tell

where

this

bus

goes?

Ref 9

Where's

this

bus

headed?

Ref 10

Where

this

bus

heading

for?

Ref 11

What

the

destination

this

bus?

Ref 12

Where

will

this

bus

take

to?

Ref 13

Where

this

bus

headed?

Ref 14

Where

this

bus

going?

Ref 15

What

this

bus'

destination?

Output 0

Where

this

bus

gone

to?

N-grams

Where	is	this	bus	gone	to?
Where	is	this	bus		to?
Where is		this bus
Where is this
Where is this bus
	is this
	is this bus

Output 1

where

bus

this

N-grams

where	bus	this	to	?
where	bus	this

Output 2

Where

the

purpose

his

bus?

N-grams

Where	the	purpose	of	his	bus?
Where	the		of		bus?

Output 3

Where

this

bus

gone

to?

N-grams

Where	is	this	bus	gone	to?
Where	is	this	bus		to?
Where is		this bus
Where is this
Where is this bus
	is this
	is this bus

Output 4

This

bus

where?

N-grams

This	bus	to	where?
	bus

Sentence 491) BLEU: 0 (0.5/0.2/0/0) ; 0 (0/0/0/0) ; 0 (0.5/0.2/0/0) ; 0 (0.1/0/0/0) ; 0 (0.1667/0/0/0)

Source

��

�Q

�n

��s

��

�[

�@��

�¤h��

�C

Ref 0

I'll

have

whiskey

the

rocks,

please.

Ref 1

would

whiskey

the

rocks,

please.

Ref 2

whiskey

the

rocks,

please.

Ref 3

Please

give

whiskey

the

rocks.

Ref 4

Whiskey

the

rocks,

please.

Ref 5

Please

give

whiskey

ice.

Ref 6

I'll

take

whiskey

the

rocks,

please.

Ref 7

Could

have

whiskey

the

rocks,

please?

Ref 8

Whiskey

the

rocks,

please.

Ref 9

Please

make

that

whiskey

the

rocks.

Ref 10

Whiskey

the

rocks,

please.

Ref 11

I'd

whiskey

the

rocks.

Ref 12

whiskey

the

rocks

for

me,

thanks.

Ref 13

I'll

take

whiskey

the

rocks,

please.

Ref 14

I'll

drink

whiskey

the

rocks,

please.

Ref 15

Please

give

whiskey

the

rocks.

Output 0

I'd

some

whiskey

cocktails

riga.

N-grams

I'd	like	some	whiskey	cocktails	riga.
I'd	like		whiskey
I'd like

Output 1

some

riga

want

N-grams

some

riga

want

Output 2

I'd

some

whiskey

cocktails

Riga.

N-grams

I'd	like	some	whiskey	cocktails	Riga.
I'd	like		whiskey
I'd like

Output 3

want

chicken

tail

add

some

whiskies

wine.

N-grams

I	want	chicken	tail	to	add	some	whiskies	in	wine.
I

Output 4

want

cocktail

Riga

some

whisky.

N-grams

I	want	cocktail	Riga	some	whisky.
I

Sentence 492) BLEU: 0 (0.75/0.3333/0/0) ; 0 (0.25/0/0/0) ; 0 (0.75/0.3333/0/0) ; 0 (0.2/0/0/0) ; 0 (0.4/0.25/0/0)

Source

��

�o

��

�@�P

��

�k�h

�C

Ref 0

have

sharp

pain

here.

Ref 1

There

sharp

pain

here.

Ref 2

feel

sharp

pain

here.

Ref 3

Here

feel

sharp

pain.

Ref 4

I'm

experiencing

sharp

pain

right

here.

Ref 5

I've

got

sharp

pain

right

here.

Ref 6

keep

getting

sharp

pain

here.

Ref 7

This

part

very

painful.

Ref 8

I'm

quite

bit

pain

here.

Ref 9

This

area

hurts

great

deal.

Ref 10

feel

stinging

pain

here.

Ref 11

I've

got

acute

pain

just

here.

Ref 12

have

such

acute

pain

here.

Ref 13

There

sharp

pain

here.

Ref 14

There

stinging

pain

here.

Ref 15

have

acute

pain

here.

Output 0

have

severe

pain.

N-grams

I	have	severe	pain.
I	have		pain.
I have

Output 1

have

ache

N-grams

i	have	ache	.
	have

Output 2

have

severe

pain.

N-grams

I	have	severe	pain.
I	have		pain.
I have

Output 3

this

has

violent

ache.

N-grams

I	this	has	violent	ache.
I

Output 4

have

the

fierce

ache.

N-grams

I	have	the	fierce	ache.
I	have
I have

Sentence 493) BLEU: 0.6914 (1/0.8571/0.6667/0.4) ; 0 (0.8333/0.6/0.5/0) ; 0.8409 (1/1/0.75/0.6667) ; 0.6914 (1/0.8571/0.6667/0.4) ; 0 (0/0/0/0)

Source

�ϵe��

�b

�G

��

�C

Ref 0

Picture

books

are

the

second

floor.

Ref 1

The

second

floor

has

picture

books.

Ref 2

There

are

picture

books

the

second

floor.

Ref 3

the

second

floor

you

can

find

picture

books.

Ref 4

Illustrated

books

are

the

second

floor.

Ref 5

You'll

find

the

picture

books

floor

two.

Ref 6

The

illustrated

books

are

kept

the

second

floor.

Ref 7

You

can

find

picture

books

the

second

floor.

Ref 8

Picture

books

are

located

the

second

floor.

Ref 9

Children's

books

can

found

the

second

floor.

Ref 10

the

second

floor

you

can

find

picture

books.

Ref 11

You'll

find

picture

books

the

second

floor.

Ref 12

Please

the

second

floor

for

picture

books.

Ref 13

The

picture

books

are

located

the

second

floor.

Ref 14

You

can

find

picture

books

the

second

floor.

Ref 15

The

picture

book

section

the

second

floor.

Output 0

The

picture

book

the

second

floor.

N-grams

The	picture	book	is	on	the	second	floor.
The	picture	book	is	on	the	second	floor.
The picture			is on		the second
The picture book			is on the			second floor.
	picture book		is on the second
				on the
				on the second
				on the second floor.
					the second floor.

Output 1

picture

the

second

floor

N-grams

picture	on	the	second	floor	.
picture	on	the	second	floor
	on the		second floor
	on the second
		the second
		the second floor

Output 2

Picture

books

the

second

floor.

N-grams

Picture	books	on	the	second	floor.
Picture	books	on	the	second	floor.
Picture books		on the		second floor.
	books on		the second
	books on the
	books on the second
		on the second
		on the second floor.
			the second floor.

Output 3

The

picture

book

the

second

floor.

N-grams

The	picture	book	is	on	the	second	floor.
The	picture	book	is	on	the	second	floor.
The picture			is on		the second
The picture book			is on the			second floor.
	picture book		is on the second
				on the
				on the second
				on the second floor.
					the second floor.

Output 4

Picture-book

two

buildings.

N-grams

Picture-book

two

buildings.

Sentence 494) BLEU: 0 (0.2857/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.2857/0/0/0) ; 0 (0.3333/0/0/0)

Source

�O�D

�a

�F

�C

Ref 0

The

shower

doesn't

work.

Ref 1

The

shower

broken.

Ref 2

The

shower

out

order.

Ref 3

The

shower

not

working.

Ref 4

The

shower

broken.

Ref 5

The

shower

got

something

wrong

with

it.

Ref 6

The

shower

won't

work.

Ref 7

The

shower

the

blitz.

Ref 8

can't

use

the

shower.

Ref 9

The

shower

not

working.

Ref 10

The

shower

broken.

Ref 11

The

shower

has

broken

down.

Ref 12

The

shower

not

functioning.

Ref 13

The

shower

out

order.

Ref 14

There's

water

coming

out

the

shower.

Ref 15

The

shower

broken.

Output 0

Took

shower

bath

break

down.

N-grams

Took	a	shower	bath	to	break	down.
		shower				down.

Output 1

shower

N-grams

shower	.
shower

Output 2

Shower

broken.

N-grams

Shower	broken.
	broken.

Output 3

Took

shower

bath

break

down.

N-grams

Took	a	shower	bath	to	break	down.
		shower				down.

Output 4

Showered

bad.

N-grams

Showered	is	bad.
	is

Sentence 495) BLEU: 0 (0.6/0.25/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.6667/0.4/0.25/0) ; 0 (0.1667/0/0/0) ; 0 (0.6/0.25/0/0)

Source

��

�ۤv

��

�]

�C

Ref 0

can

carry

bags

myself.

Ref 1

can

carry

the

bags

myself.

Ref 2

can

get

the

bags

own.

Ref 3

can

carry

the

bags

without

any

help.

Ref 4

can

carry

own

luggage.

Ref 5

can

get

bags

myself.

Ref 6

can

manage

luggage

myself.

Ref 7

I'm

able

carry

own

bags.

Ref 8

can

manage

with

own

bags.

Ref 9

I've

problem

carrying

own

bags.

Ref 10

will

carry

the

bags

own.

Ref 11

Let

carry

the

bags

myself.

Ref 12

able

carry

the

bags

own.

Ref 13

can

manage

bags

own.

Ref 14

able

manage

bags

myself.

Ref 15

can

carry

them

myself.

Output 0

can

take

the

package.

N-grams

I	can	take	the	package.
I	can		the
I can

Output 1

can

N-grams

i	can	.
	can

Output 2

can

carry

his

own

bag.

N-grams

I	can	carry	his	own	bag.
I	can	carry		own
I can
I can carry
	can carry

Output 3

ability

takes

pack.

N-grams

My	ability	I	takes	a	pack.
		I

Output 4

can

take

the

package.

N-grams

I	can	take	the	package.
I	can		the
I can

Sentence 496) BLEU: 0 (0.5/0/0/0) ; 0 (0/0/0/0) ; 0 (0.3333/0/0/0) ; 0 (0.5/0/0/0) ; 0 (0.5714/0/0/0)

Source

�O��

�A

��

�@�N

�n

�G

��

�C

Ref 0

Yes,

I'll

have

the

number

two.

Ref 1

Yes.

I'll

have

number

two.

Ref 2

Yes.

Number

two,

please.

Ref 3

Yes.

Please

give

number

two.

Ref 4

Sure.

I'll

take

the

number

two.

Ref 5

Yes.

Make

the

number

two

for

me,

please.

Ref 6

OK.

I'll

with

the

number

two.

Ref 7

Okay.

I'd

number

two.

Ref 8

Alright.

Number

two

for

me,

please.

Ref 9

see.

Number

two,

please.

Ref 10

Okay.

I'll

get

number

two.

Ref 11

Fine.

I'll

order

number

two.

Ref 12

I'm

ready.

Number

two

for

me,

please.

Ref 13

Yes.

will

order

the

number

two.

Ref 14

Yes.

will

take

the

number

two.

Ref 15

Yes.

Number

two

please.

Output 0

Yes,

would

want

the

second.

N-grams

Yes,	I	would	like	to	want	the	second.
Yes,	I		like			the

Output 1

yes

willing

N-grams

yes

willing

Output 2

Yes,

willing

II.

N-grams

Yes,	I	am	willing	to	II.
Yes,	I

Output 3

Yes,

would

want

the

second.

N-grams

Yes,	I	would	like	to	want	the	second.
Yes,	I		like			the

Output 4

Yes,

willing

take

two.

N-grams

Yes,	I	am	willing	to	take	two.
Yes,	I				take	two.

Sentence 497) BLEU: 1 (1/1/1/1) ; 0 (0.4/0.25/0/0) ; 1 (1/1/1/1) ; 0 (0.75/0.3333/0/0) ; 0 (0.75/0.3333/0/0)

Source

��

��]

�Q

��

�F

�C

Ref 0

wallet

was

stolen.

Ref 1

had

wallet

stolen.

Ref 2

wallet

has

been

stolen.

Ref 3

Someone

stole

wallet.

Ref 4

wallet

was

taken.

Ref 5

Somebody

stole

wallet.

Ref 6

Somebody

took

wallet.

Ref 7

wallet

has

been

taken.

Ref 8

got

wallet

stolen.

Ref 9

wallet's

been

lifted.

Ref 10

had

wallet

stolen.

Ref 11

Someone

stole

purse.

Ref 12

purse

has

been

taken.

Ref 13

Someone

stole

wallet.

Ref 14

wallet

was

taken.

Ref 15

wallet

was

lifted.

Output 0

wallet

was

stolen.

N-grams

My	wallet	was	stolen.
My	wallet	was	stolen.
My wallet		was stolen.
My wallet was
My wallet was stolen.
	wallet was
	wallet was stolen.

Output 1

wallet

stolen

N-grams

my	wallet	stolen	is	.
my	wallet
my wallet

Output 2

wallet

was

stolen.

N-grams

My	wallet	was	stolen.
My	wallet	was	stolen.
My wallet		was stolen.
My wallet was
My wallet was stolen.
	wallet was
	wallet was stolen.

Output 3

purse

stolen.

N-grams

My	purse	is	stolen.
My	purse		stolen.
My purse

Output 4

wallet

stolen.

N-grams

My	wallet	is	stolen.
My	wallet		stolen.
My wallet

Sentence 498) BLEU: 0.7071 (1/0.8333/0.6/0.5) ; 0 (0.6667/0.2/0/0) ; 0.8409 (1/0.8333/0.8/0.75) ; 0.7071 (1/0.8333/0.6/0.5) ; 0 (0.25/0/0/0)

Source

��

�h

�ݹq�v

��

�H

Ref 0

How

about

going

the

movies

tonight?

Ref 1

How

would

you

the

movies

tonight?

Ref 2

How

about

going

with

the

movies

this

evening?

Ref 3

What

you

think

about

going

the

movies

tonight?

Ref 4

What

would

you

think

taking

movie

tonight?

Ref 5

What

you

say

see

movie

tonight?

Ref 6

What

about

going

movie

tonight?

Ref 7

What

you

think

going

movie

tonight?

Ref 8

How

would

you

movie

tonight?

Ref 9

Are

you

interested

going

movie

tonight?

Ref 10

What

you

think

about

going

the

movies

tonight?

Ref 11

What

you

say

the

movies

tonight?

Ref 12

Shall

the

movies

tonight?

Ref 13

How

about

going

see

movie

tonight?

Ref 14

Let's

see

movie

tonight?

Ref 15

How

does

seeing

movie

tonight

sound?

Output 0

How

about

going

the

movie

tonight?

N-grams

How	about	going	to	the	movie	tonight?
How	about	going	to	the	movie	tonight?
How about		going to			movie tonight?
How about going			to the
How about going to
	about going
	about going to
	about going to the
		going to the

Output 1

how

movie

tonight

the

N-grams

how	to	movie	tonight	the	?
	to	movie	tonight	the
		movie tonight

Output 2

How

movie

tonight?

N-grams

How	to	go	to	a	movie	tonight?
How	to	go	to	a	movie	tonight?
	to go		to a		movie tonight?
	to go to			a movie
	to go to a
		go to		a movie tonight?
		go to a
		go to a movie
			to a movie
			to a movie tonight?

Output 3

How

about

going

the

movie

tonight?

N-grams

How	about	going	to	the	movie	tonight?
How	about	going	to	the	movie	tonight?
How about		going to			movie tonight?
How about going			to the
How about going to
	about going
	about going to
	about going to the
		going to the

Output 4

Tonight

looked

the

movie

what

kind

of?

N-grams

Tonight	looked	the	movie	is	what	kind	of?
		the	movie

Sentence 499) BLEU: 1 (1/1/1/1) ; 0 (0.6/0/0/0) ; 1 (1/1/1/1) ; 0 (1/0.6667/0/0) ; 0 (1/0.6667/0/0)

Source

��

�Ҽ{

�@�U

��

�C

Ref 0

Let

think

about

it.

Ref 1

Let

think

about

little

bit.

Ref 2

Give

some

time

think

about

it.

Ref 3

Let

think

over.

Ref 4

Give

minute

think.

Ref 5

Let

mull

over

for

second.

Ref 6

Let

have

minute

consider

it.

Ref 7

I'd

think

about

it.

Ref 8

Would

you

give

moment?

Ref 9

Could

think

about

it?

Ref 10

Give

some

time

think

about

it.

Ref 11

Allow

think

about

this

little.

Ref 12

would

think

about

this

for

while.

Ref 13

thinking

about

it.

Ref 14

Let

think

over.

Ref 15

Let

ponder

over.

Output 0

Let

think

about

it.

N-grams

Let	me	think	about	it.
Let	me	think	about	it.
Let me		think about
Let me think			about it.
Let me think about
	me think
	me think about
	me think about it.
		think about it.

Output 1

let

consider

N-grams

let	me	it	consider	.
	me	it	consider

Output 2

Let

think

about

it.

N-grams

Let	me	think	about	it.
Let	me	think	about	it.
Let me		think about
Let me think			about it.
Let me think about
	me think
	me think about
	me think about it.
		think about it.

Output 3

Let

consider

it.

N-grams

Let	me	consider	it.
Let	me	consider	it.
Let me		consider it.

Output 4

Let

consider

it.

N-grams

Let	me	consider	it.
Let	me	consider	it.
Let me		consider it.

Sentence 500) BLEU: 0.502 (0.8889/0.5/0.4286/0.3333) ; 0 (0.5/0/0/0) ; 0.502 (0.8889/0.5/0.4286/0.3333) ; 0.3303 (0.6667/0.375/0.2857/0.1667) ; 0 (0.4/0.1111/0/0)

Source

��

�T�w

�C

��O

��

�W��

�T��

�O

�K�y�f

�C

Ref 0

I'm

not

sure.

But

that

blouse

real

bargain.

Ref 1

don't

know.

But

that

blouse

great

bargain.

Ref 2

I'm

not

sure.

But

that

blouse

steal.

Ref 3

I'm

not

sure.

But

that

blouse

sure

cheap.

Ref 4

don't

really

know.

But

that

blouse

real

find,

isn't

it?

Ref 5

don't

know

for

sure.

But

that

blouse

good

deal,

isn't

it?

Ref 6

I'm

not

too

sure.

But,

that

blouse

steal,

isn't

it?

Ref 7

don't

know.

That

blouse,

though,

deal

for

sure.

Ref 8

It's

not

clear.

But

that

blouse

steal.

Ref 9

That

don't

know.

for

that

blouse,

it's

great

buy

though,

isn't

it?

Ref 10

haven't

decided.

That's

really

good

bargain

for

that

blouse,

though.

Ref 11

I'm

undecided.

But

what

bargain

for

the

blouse.

Ref 12

wonder

should

get

it.

It's

really

cheap

for

what

is.

Ref 13

don't

know

well.

Except

that

blouse

real

good

find.

Ref 14

don't

know

lot

about

it.

But

that

blouse

true

find.

Ref 15

don't

know

much

about

it.

But

that

blouse

good

find.

Output 0

I'm

not

sure.

But

that

shirt

really

cheap.

N-grams

I'm	not	sure.	But	that	shirt	is	really	cheap.
I'm	not	sure.	But	that		is	really	cheap.
I'm not		sure. But
I'm not sure.			But that
I'm not sure. But
	not sure.
	not sure. But
	not sure. But that
		sure. But that

Output 1

but

that

really

N-grams

i	but	that	is	really	.
		that	is	really

Output 2

I'm

not

sure.

But

that

shirt

really

cheap.

N-grams

I'm	not	sure.	But	that	shirt	is	really	cheap.
I'm	not	sure.	But	that		is	really	cheap.
I'm not		sure. But
I'm not sure.			But that
I'm not sure. But
	not sure.
	not sure. But
	not sure. But that
		sure. But that

Output 3

indetermination.

But

that

blouse

really

gewgaw.

N-grams

My	indetermination.	But	that	blouse	is	really	a	gewgaw.
		But	that	blouse	is	really	a
		But that		blouse is
		But that blouse
		But that blouse is
			that blouse
			that blouse is

Output 4

indefinite.

But

that

coat

bargain-priced

goods

truly.

N-grams

I	am	indefinite.	But	that	coat	is	bargain-priced	goods	truly.
I			But	that		is
			But that

Sentence 501) BLEU: 0 (1/0/0/0) ; 0 (0/0/0/0) ; 0 (0/0/0/0) ; 0 (1/0/0/0) ; 0 (1/0/0/0)

Source

�

�C

Ref 0

No.

Ref 1

Nope.

Ref 2

thanks.

Ref 3

Huh-uh.

Ref 4

Nope.

Ref 5

It's

not.

Ref 6

Nope.

Ref 7

way.

Ref 8

Not

all.

Ref 9

You're

welcome.

Ref 10

problem.

Ref 11

Nope.

Ref 12

thanks.

Ref 13

Not.

Ref 14

No.

Ref 15

No.

Output 0

No.

N-grams

No.

Output 1

N-grams

Output 2

不.

N-grams

不.

Output 3

Not.

N-grams

Not.

Output 4

No.

N-grams

No.

Sentence 502) BLEU: 0 (1/1/1/0) ; 0 (0.4/0/0/0) ; 0 (0.5/0/0/0) ; 0 (1/1/1/0) ; 0 (0.5/0/0/0)

Source

��

�b

�o

ñ�W

�C

Ref 0

Please

sign

here.

Ref 1

Please

sign

this

here.

Ref 2

Please

sign

your

name

here.

Ref 3

Please

put

your

signature

here.

Ref 4

Please

put

your

signature

here.

Ref 5

Please

sign

your

name

here.

Ref 6

Please

put

your

name

here.

Ref 7

Would

you

sign

here,

please?

Ref 8

Could

you

sign

right

here?

Ref 9

Your

signature

here,

please.

Ref 10

Could

you

sign

here?

Ref 11

I'd

you

write

your

signature

here.

Ref 12

Could

you

put

your

signature

here?

Ref 13

Please

sign

your

name

here.

Ref 14

Your

signature

required

here.

Ref 15

Your

signature

goes

here.

Output 0

Please

sign

here.

N-grams

Please	sign	here.
Please	sign	here.
Please sign
Please sign here.
	sign here.

Output 1

this

signature

please

N-grams

in	this	signature	please	.
	this	signature

Output 2

this

signature,

please.

N-grams

In	this	signature,	please.
	this		please.

Output 3

Please

sign

here.

N-grams

Please	sign	here.
Please	sign	here.
Please sign
Please sign here.
	sign here.

Output 4

Please

this

signature.

N-grams

Please	in	this	signature.
Please		this

Sentence 503) BLEU: 0 (0.5455/0.1/0/0) ; 0 (0.6667/0.2727/0/0) ; 0 (0.5455/0.1/0/0) ; 0 (0.7273/0/0/0) ; 0 (0.3333/0/0/0)

Source

�̾�

��@

�B��

��

��]

��m

��

�K�Q

�C

Ref 0

This

hotel

conveniently

located

terms

public

transportation.

Ref 1

This

hotel

conveniently

located

for

public

transportation.

Ref 2

This

hotel

has

great

access

public

transportation.

Ref 3

This

hotel

easily

accessible

through

public

transportation.

Ref 4

This

hotel

convenient

place

for

public

transportation.

Ref 5

The

location

this

hotel

convenient

public

transportation.

Ref 6

far

public

transportation

goes,

this

hotel

convenient

place.

Ref 7

The

location

this

hotel

convenient

for

taking

public

transportation.

Ref 8

This

hotel

convenient

location

for

taking

public

transportation.

Ref 9

This

hotel

situated

for

convenient

access

public

transportation.

Ref 10

This

hotel

positioned

very

convenient

place

far

transportation

concerned.

Ref 11

The

position

this

hotel

convenient

for

access

transportation.

Ref 12

Public

transport

easily

accessible

from

this

hotel.

Ref 13

This

hotel

conveniently

located

public

transportation.

Ref 14

This

hotel's

location

convenient

for

taking

public

transportation.

Ref 15

This

hotel

convenient

location

for

access

public

transportation.

Output 0

Based

public

transport

that

the

hotel

location

very

convenient.

N-grams

Based	on	public	transport	that	the	hotel	location	is	very	convenient.
		public	transport			hotel	location	is	very
							location is

Output 1

public

transport

that

the

hotel

very

convenient

position

N-grams

on	public	transport	that	the	hotel	is	very	convenient	to	position	.
	public	transport			hotel	is	very	convenient	to	position
					hotel is		very convenient
								convenient to

Output 2

Based

public

transport

that

the

hotel

location

very

convenient.

N-grams

Based	on	public	transport	that	the	hotel	location	is	very	convenient.
		public	transport			hotel	location	is	very
							location is

Output 3

The

basis

public

transport

that

hotel

position

very

convenient.

N-grams

The	basis	is	public	to	transport	that	hotel	position	very	convenient.
The		is	public	to	transport		hotel	position	very

Output 4

Rests

the

common

carriage

that

hotel

position

very

convenient.

N-grams

Rests	on	the	common	carriage	that	hotel	position	to	be	very	convenient.
						hotel	position	to		very

Sentence 504) BLEU: 0 (0.4/0/0/0) ; 0 (0.3333/0.2/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.6/0.25/0/0) ; 0 (0.4/0/0/0)

Source

��

�O

�K�

��~

�C

Ref 0

Those

are

duty-free

items.

Ref 1

Those

items

are

duty-free.

Ref 2

Those

are

duty-free

things.

Ref 3

Those

products

are

duty-free

ones.

Ref 4

Those

things

are

duty-free.

Ref 5

Those

are

duty-free.

Ref 6

Those

would

duty-free.

Ref 7

Those

would

duty-free

items.

Ref 8

duty-free

purchases.

Ref 9

They

are

duty-free.

Ref 10

They

are

tax-free

items.

Ref 11

Those

ones

are

not

taxable.

Ref 12

Those

things

bought

duty-free.

Ref 13

Those

things

are

duty

free.

Ref 14

Those

things

are

free

duty.

Ref 15

Those

are

duty-free

items.

Output 0

These

are

the

duty-free

articles.

N-grams

These	are	the	duty-free	articles.
	are		duty-free

Output 1

those

are

duty-free

the

articles

N-grams

those	are	duty-free	the	articles	.
	are	duty-free
	are duty-free

Output 2

Those

who

are

duty-free

goods.

N-grams

Those	who	are	duty-free	goods.
Those		are	duty-free
		are duty-free

Output 3

Those

are

the

tax-free

articles.

N-grams

Those	are	the	tax-free	articles.
Those	are		tax-free
Those are

Output 4

These

are

the

duty-free

articles.

N-grams

These	are	the	duty-free	articles.
	are		duty-free

Sentence 505) BLEU: 0 (0.5/0.3333/0/0) ; 0 (0.6667/0/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.5/0.3333/0/0) ; 0 (0.25/0/0/0)

Source

�O

�a

�F

�C

Ref 0

The

lights

are

not

working.

Ref 1

The

lights

are

out.

Ref 2

The

lights

won't

turn

on.

Ref 3

The

lights

are

out

order.

Ref 4

The

lights

won't

come

on.

Ref 5

The

lights

won't

on.

Ref 6

The

lights

won't

turn

on.

Ref 7

The

lights

don't

work.

Ref 8

The

lights

won't

on.

Ref 9

The

light

doesn't

turn

on.

Ref 10

The

lights

don't

turn

on.

Ref 11

can't

get

the

lights

work.

Ref 12

can't

switch

the

lights

on.

Ref 13

The

lights

won't

on.

Ref 14

The

lights

don't

light.

Ref 15

The

lights

are

out

order.

Output 0

The

light

broke

down.

N-grams

The	light	broke	down.
The	light
The light

Output 1

light

the

N-grams

light	the	.
light	the

Output 2

Light

not

working.

N-grams

Light	is	not	working.
		not	working.
		not working.

Output 3

The

light

broke

down.

N-grams

The	light	broke	down.
The	light
The light

Output 4

The

lamp

was

bad.

N-grams

The	lamp	was	bad.
The